-- Logs begin at Tue 2022-02-08 16:34:39 UTC, end at Tue 2022-02-08 17:53:13 UTC. -- Feb 08 17:19:40.373637 dv-cinder-822040-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 08 17:19:40.382675 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 08 17:19:40.384643 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 8 17:19:40 2022] *** Feb 08 17:19:40.384643 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 08 17:19:40.384643 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 08 17:19:40.384643 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: nodename: dv-cinder-822040-2-iscsi Feb 08 17:19:40.384643 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: machine: x86_64 Feb 08 17:19:40.384643 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: clock source: unix Feb 08 17:19:40.384643 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: pcre jit disabled Feb 08 17:19:40.384643 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: detected number of CPU cores: 4 Feb 08 17:19:40.384643 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: current working directory: / Feb 08 17:19:40.384643 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: detected binary path: /usr/bin/uwsgi-core Feb 08 17:19:40.385355 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: your processes number limit is 47680 Feb 08 17:19:40.385355 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: your memory page size is 4096 bytes Feb 08 17:19:40.385355 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: detected max file descriptor number: 2048 Feb 08 17:19:40.385355 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: lock engine: pthread robust mutexes Feb 08 17:19:40.385355 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: thunder lock: enabled Feb 08 17:19:40.385355 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 08 17:19:40.385355 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 08 17:19:40.429597 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: Python main interpreter initialized at 0x562351a2b9c0 Feb 08 17:19:40.429597 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: python threads support enabled Feb 08 17:19:40.429597 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: your server socket listen backlog is limited to 100 connections Feb 08 17:19:40.429597 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: your mercy for graceful operations on workers is 90 seconds Feb 08 17:19:40.429932 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: mapped 403077 bytes (393 KB) for 2 cores Feb 08 17:19:40.430005 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: *** Operational MODE: preforking *** Feb 08 17:19:40.430257 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: *** uWSGI is running in multiple interpreter mode *** Feb 08 17:19:40.430257 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: spawned uWSGI master process (pid: 101850) Feb 08 17:19:40.430984 dv-cinder-822040-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 08 17:19:40.432106 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: spawned uWSGI worker 1 (pid: 101851, cores: 1) Feb 08 17:19:40.432106 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: spawned uWSGI worker 2 (pid: 101852, cores: 1) Feb 08 17:19:40.432106 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 08 17:19:42.240189 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 17:19:42.240189 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: from cryptography.utils import int_from_bytes Feb 08 17:19:42.240853 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 17:19:42.240853 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: from cryptography.utils import int_from_bytes Feb 08 17:19:42.257664 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 17:19:42.257664 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: from cryptography.utils import int_from_bytes Feb 08 17:19:42.258170 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 17:19:42.258170 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: from cryptography.utils import int_from_bytes Feb 08 17:19:44.869571 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 17:19:44.870257 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 17:19:44.870350 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 17:19:44.870711 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 17:19:44.870803 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 17:19:44.870891 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 17:19:44.871017 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 17:19:44.871156 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 17:19:44.871391 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 17:19:44.871503 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.871652 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 17:19:44.871747 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.872028 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.872133 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.872352 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.872452 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.872676 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.872772 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.872981 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.873075 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.873326 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.873417 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.873645 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.873733 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.873970 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.874058 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.874231 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.874341 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.874549 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.874646 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.874868 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.874956 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822040-2-iscsi {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.875186 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.875286 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.875494 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.875589 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822040-2-iscsi {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.875804 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.875900 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.876121 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.876222 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.876423 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.876511 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.876824 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.876922 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.877051 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.877147 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.877399 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.877582 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.877725 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.878723 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.878843 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.878926 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.878993 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.879324 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.879399 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.879464 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.879537 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.879603 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.879822 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.879929 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.880147 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.880328 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.880457 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.880554 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.880776 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.880863 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.881093 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.881231 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.881447 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.881534 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822040-2-iscsi {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.881765 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.881864 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.882123 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.882218 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822040-2-iscsi {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.882440 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.882604 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.882856 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.882944 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.883170 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.883255 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.883483 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.883683 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.884347 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.884653 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.884795 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.884975 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.885083 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.885324 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.885427 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.885651 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.885776 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.885968 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.886099 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.886287 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.886433 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.886593 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.886763 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.886904 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.887137 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.887234 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.887526 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.887623 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.887834 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.887923 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.888139 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.888226 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.888396 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.888563 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.888705 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.888842 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.889013 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.889148 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.889361 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.889512 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.889845 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.889938 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.890104 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.890219 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.890370 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.890529 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.890693 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.890969 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.891108 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.891312 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.891421 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.891615 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.891704 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.891876 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.891972 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.892210 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.892358 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.892516 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.892611 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.892824 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.892913 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.893133 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.893239 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.893465 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.893553 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.893785 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.893872 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.894100 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.894189 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.894424 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.894512 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.894734 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.894830 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.895055 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.895144 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.895453 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.895621 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.895764 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.895904 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.896054 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.896194 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.896348 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.896488 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.896627 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.896785 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.896930 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.897117 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.897327 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.897480 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.897626 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.897774 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.897922 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.898061 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.898210 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.898356 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.898498 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.898645 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.898785 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.898956 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.899104 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.899381 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.900064 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.900221 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.900415 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.901151 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.901266 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.901361 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.901450 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.901531 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.901608 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.901691 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.901691 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.901842 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.902006 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.902120 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.902284 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.902381 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.902595 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.902698 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.902901 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.902999 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.903209 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.903301 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.903517 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.903620 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.903825 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.903929 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.904130 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.904279 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.904439 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.904642 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.904734 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.904965 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.905072 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.905304 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.905408 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.905623 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.905712 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.905940 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.906028 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.906255 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.906351 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.906559 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.906653 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.906907 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.907038 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.907186 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.907351 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.907494 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.907622 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.907802 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.908025 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.908116 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.908387 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.908475 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.908705 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.908793 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.909019 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.909105 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.909353 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.909446 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.909664 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.909759 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.910050 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.910161 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.910279 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.910476 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.910657 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.910802 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.910917 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.911150 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.911251 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.911474 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.911561 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.911789 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.911880 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.912119 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.912236 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.912423 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.912514 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.912727 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.912826 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.913030 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.913123 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.913366 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.913458 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.913670 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.913760 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.913991 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.914092 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.914304 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.914394 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.914613 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.914706 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.914921 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.915012 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.915251 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.915342 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.915560 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.915650 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.915871 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.915963 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.916181 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.916280 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.916491 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.916591 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.916797 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.916889 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.917124 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.917251 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.917478 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.917579 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.917795 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.917894 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.918107 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.918197 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.918417 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.918516 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.918742 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.918840 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:19:44.919055 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.919147 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.919368 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.919470 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.919681 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.919779 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.920003 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.920095 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.920324 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.920423 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.920654 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.920761 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.920973 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.921078 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.921314 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.921418 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.921636 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.921725 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.921951 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.922040 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.922272 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.922393 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.922615 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.922711 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.922908 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.923016 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.923215 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.923304 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.923541 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.923629 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.923878 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.923974 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.924189 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.924276 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.924515 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.924617 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.924836 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.924933 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.925150 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.925306 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.925480 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.925577 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.925795 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.925896 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.927215 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.927324 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.927324 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.927533 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.927533 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.927692 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.927781 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.927868 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.927948 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.928026 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.928103 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.928189 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.928270 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.928360 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.928440 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.928525 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.928604 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.928691 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.928881 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.928978 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.929216 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.929321 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.929536 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.929627 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.929851 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.929947 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.930167 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.930257 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.930481 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.930569 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.930819 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.930906 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.931134 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.931222 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.931445 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.931584 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.931752 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.931839 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.932057 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.932156 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.932368 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.932470 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.932669 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.932758 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.932990 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.933093 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.933341 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.933433 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.933649 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.933739 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.933966 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.934074 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.934278 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.934365 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.934588 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.934693 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.934897 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.934993 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.935218 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.935379 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.935512 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.935641 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.935814 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.935914 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.936124 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.936225 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.936428 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.936523 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.936749 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.936838 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.937060 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.937151 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.937390 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.937480 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.937713 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.937805 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.938017 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.938107 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.938323 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.938426 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.938635 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.938725 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.938941 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.939028 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.939253 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.939350 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.939561 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.939649 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.939882 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.939977 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.940194 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.940292 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.940502 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.940588 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.940828 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.940914 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.941141 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.941315 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.941474 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.941561 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.941794 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.941884 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.942109 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.942210 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.942433 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.942593 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.942730 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.942874 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.943038 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.943138 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.943342 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.943433 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.943647 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.943739 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.943952 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.944044 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.944260 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.944357 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.944563 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.944652 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.944867 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.944966 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.945190 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.945296 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.945492 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.945604 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.945794 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.945883 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.946117 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.946208 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.946968 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.947078 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.947275 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.947407 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.947579 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.947668 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.947883 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.947983 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.948190 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.948320 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.948503 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.948591 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.948813 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.948912 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.949121 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.949230 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.949454 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.949542 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.949786 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.949898 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.950100 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.950188 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.950413 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.950507 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.950723 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.950844 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.951033 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.951127 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.951346 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.951480 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.951658 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.951747 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.951985 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.952079 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.952297 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.952391 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.952620 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.952721 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.952929 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.953018 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.953285 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.953388 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.953598 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.953686 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.953911 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.954002 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.954214 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.954308 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.954530 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.954619 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.954844 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.954973 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.955176 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.955263 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.955502 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.955629 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.955814 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.955901 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.956127 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.956226 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.956438 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.956524 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.956747 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.956840 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.957059 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.957192 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.957393 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.957488 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.957703 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.957796 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.958022 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.958123 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.958334 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.958436 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.958650 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.958738 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.958957 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.959119 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.959279 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.959366 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.959587 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.959673 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.959898 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.959986 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.960200 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.960286 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.960512 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.960606 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.960825 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.960912 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.961169 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.961263 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.961490 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.961620 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.961805 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.961935 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.962720 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.962826 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.963004 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.963091 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.963313 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.963406 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.963624 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.963722 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.963929 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.964024 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.964235 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.964323 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.964545 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.964637 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.964856 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.964956 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.965195 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.965289 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.965496 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.965588 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.965799 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.965898 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.966114 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.966201 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.966425 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.966517 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.966732 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.966833 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.967036 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.967133 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.967344 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.967438 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.967658 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.967754 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.967968 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.968062 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.968282 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.968368 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.968595 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.968688 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.968898 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.968988 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.969225 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.969319 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.969546 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.969636 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.969854 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.969954 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.970161 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.970247 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.970466 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.970562 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.970773 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.970894 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.971093 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.971267 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.971456 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.971687 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.971774 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.972008 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.972097 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.972327 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.972418 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.972650 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.972785 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.972965 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.973077 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.973298 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.973390 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.973610 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.973712 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.973921 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.974008 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.974241 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.974423 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.974587 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.974675 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.974855 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.974947 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.975172 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.975264 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.975486 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.975584 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.975800 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.975941 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.976114 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.976203 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.976427 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.976518 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.976734 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.976836 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.977048 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.977136 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.977386 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.977476 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.977717 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.977820 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.978030 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.978118 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.978345 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.978442 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.978662 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.978926 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.979015 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.979262 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.979395 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.979580 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.979676 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.979896 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.979988 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.980215 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.980310 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.980526 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.980621 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.980844 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.980935 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.981193 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.981288 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.981507 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.981764 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.981889 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.982102 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.982190 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.982425 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.982524 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.982734 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.982832 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.983055 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.983223 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.983387 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.983533 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.983687 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.983843 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.983999 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.984142 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.984299 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.984452 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.984623 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.984776 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.984919 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.985058 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.985348 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.985505 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.985645 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.985786 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.985965 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.986104 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.986240 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.986374 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.986525 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.986678 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.986821 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.986970 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.987108 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.987245 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.987382 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.987535 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.987674 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.987808 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.987944 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.988093 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.988240 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.988394 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.988530 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.988668 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.988810 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.988945 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.989067 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.989240 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.989383 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.989520 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.989686 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.989829 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.989993 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.990131 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.990273 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.990410 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.990591 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.990739 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.990892 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.991032 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.991182 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.991320 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.991456 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.991594 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.991761 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.991931 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.992072 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.992316 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.992470 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.992608 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.992762 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.992899 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.993038 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.993296 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.993435 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.993593 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.993731 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.993871 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.994017 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.994164 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.994311 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.994458 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.994595 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.994743 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.994883 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.995024 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.995162 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.995313 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.995528 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.995728 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.995927 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.996115 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.996310 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.996516 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.996707 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.996897 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.997094 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.997317 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.997531 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.997531 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.997899 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.998093 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.998287 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.998482 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.998699 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.998894 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.999093 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.999288 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.999480 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.999678 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:44.999881 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.000076 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.000268 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.000457 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.000807 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.001020 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.001269 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.001476 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.001838 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.002036 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.002232 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.002460 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.002757 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.002953 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.003160 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.003348 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.003543 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.003750 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.003957 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.004410 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.004604 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.004807 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.004998 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.005222 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.005437 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.005630 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.005825 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.006021 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.006227 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.006438 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.006644 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.006844 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.007044 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.007239 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.007451 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.007650 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.007842 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.008040 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.008233 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.008428 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.008638 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.009646 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.009849 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.010044 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.010236 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.010431 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.010642 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.010848 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.011053 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.011248 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.011444 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.011635 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.011842 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.012037 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.012229 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.012420 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.012612 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.012934 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.013131 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.013348 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.013541 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.013733 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.013930 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.014143 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.014339 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.014529 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.014721 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.014915 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.015150 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.015357 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.015554 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.015760 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.015955 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.016147 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.016341 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.016549 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.016742 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.016950 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.017200 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.017544 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.017758 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.017993 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.018187 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.018379 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.018595 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.018802 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.019106 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.019303 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.019489 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.019686 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.019880 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.020075 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.020287 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.020482 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.020705 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.020899 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.021095 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.021330 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.021545 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.021738 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.021930 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.022127 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.022320 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.022515 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.022724 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.022938 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.023243 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.023477 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.023675 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.023887 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.024085 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.024278 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.025031 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.025269 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.025468 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.025679 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.025877 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.026073 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.026268 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.026464 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.026704 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.026914 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.027106 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.027317 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.027515 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.027719 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.027914 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.028122 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.028319 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.028513 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.028706 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.028899 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.029107 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.029357 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.029556 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.029752 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.029945 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.030146 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.030354 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.030559 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.030559 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.030943 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.030943 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.031323 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.031529 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.031723 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.031936 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.032142 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.032338 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.032524 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.032725 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.032912 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.033105 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.033368 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.033553 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.033917 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.034095 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.034274 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.034453 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.034632 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.034812 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.035009 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.035194 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.035376 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.035556 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.035733 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.035911 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.036096 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.036275 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.036448 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.036625 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.036795 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.036971 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.037176 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.037352 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.037525 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.037702 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.037882 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.038082 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.038261 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.038451 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.038633 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.038633 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.038967 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.039157 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.039334 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.039505 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.039680 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.039680 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.040045 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.040252 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.040440 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.040620 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.040800 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.040984 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.041200 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.041402 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.041586 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.041769 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.041943 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.042166 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.042360 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.042537 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.042725 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.042903 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.043078 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.043265 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.043445 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.043634 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.043802 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.043992 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.044180 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.044365 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.044552 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.044719 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.044889 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.045063 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.045291 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.045467 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.045656 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.045656 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.046003 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.046222 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.046414 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.046597 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.046779 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.046956 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.047168 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.047496 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.047685 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.047685 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.048036 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.048255 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.048441 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.048779 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.048960 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.049147 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.049374 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.049580 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.049777 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.049961 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.050140 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.050320 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.050501 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.050711 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.050894 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.051070 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.051248 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.051438 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.051622 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.051815 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.052005 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.052005 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.052358 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.052654 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.052832 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.052988 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.053193 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.053388 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.053573 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.053753 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.053935 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.054113 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.054316 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.054505 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.054691 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.054889 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.055089 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.055263 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.055438 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.055637 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.055821 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.056004 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.056187 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.056377 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.056556 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.056729 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.056905 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.057101 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.057382 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.057564 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.057740 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.057924 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.058100 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.058295 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.058511 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.058688 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.058882 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.059069 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.059244 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.059431 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.059618 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.059803 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.059984 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.060184 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.060361 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.060557 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.060734 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.060913 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.061090 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.061323 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.061528 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.061713 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.061894 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.062075 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.062265 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.062439 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.062622 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.062796 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.062976 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.063192 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.063365 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.063541 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.063723 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.063892 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.064086 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.064256 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.064433 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.064604 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.064784 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.064966 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.065150 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.065502 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.065502 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.065882 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.066054 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.066226 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.066405 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.066595 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.066771 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.066954 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.067129 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.067308 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.067487 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.067670 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.067845 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.068050 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.068243 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.068435 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.068620 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.068815 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.069002 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.069249 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.069432 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.069624 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.069624 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.069624 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.070148 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.070325 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.070513 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.070695 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.070873 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.071049 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.071849 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.072043 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.072230 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.072422 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.072605 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.072785 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.072969 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.073144 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.073366 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.073550 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.073716 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.073897 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.074070 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.074246 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.074418 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.074592 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.074768 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.074952 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.075127 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.075300 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.075486 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.075661 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.075835 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.076027 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.076205 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.076388 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.076566 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.076751 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.076931 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.077124 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.077124 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.077493 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.077676 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.077862 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.078029 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.078221 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.078400 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.078586 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.078775 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.078948 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.079130 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.079313 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.079487 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.079671 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.079847 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.080025 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.080370 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.080541 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.080541 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.080893 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.081073 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.081280 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.081487 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.081663 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.081842 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.082028 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.082227 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.082439 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.082635 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.082835 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.083032 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.083237 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.083433 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.083651 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.083838 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.084040 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.084228 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.084425 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.084621 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.084840 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.085035 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.085305 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.085495 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.085683 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.085876 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.086081 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.086279 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.086474 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.086680 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.086898 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.087640 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.087847 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.088045 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.088241 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.088434 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.088434 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.088823 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.089019 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.089235 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.089450 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.089655 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.089867 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.090060 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.090251 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.090445 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.090635 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.090844 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.091038 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.091241 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.091435 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.091626 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.091816 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.092020 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.092211 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.092402 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.092596 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.092798 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.092798 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.093246 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.093442 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.093652 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.093855 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.094057 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.094264 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.094473 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.094670 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.094868 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.095059 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.095251 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.095454 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.095699 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.095896 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.096090 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.096286 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.096636 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.096849 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.097051 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.097267 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.097466 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.097466 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.097854 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.098064 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.098260 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.098455 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.098658 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.098856 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.099052 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.099264 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.099459 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.099651 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.099857 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.100052 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.100263 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.100263 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.100624 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.100833 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.101083 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.101296 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.101507 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.101701 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.101896 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.102092 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.102282 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.102473 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.102703 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.102898 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.103087 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.103303 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.103493 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.103704 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.103897 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.104101 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.104296 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.104489 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.104681 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.104681 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.105079 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.105307 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.105500 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.105712 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.105897 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.106354 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.106574 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.106780 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.106996 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.107193 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.107390 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.107596 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.107795 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.107983 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.108197 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.108392 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.108595 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.108791 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.108986 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.109226 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.109440 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.109636 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.109846 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.110041 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.110237 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.110429 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.110623 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.110820 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.111020 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.111217 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.111413 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.111612 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.111803 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.111990 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.112203 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.112397 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.112588 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.112778 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.112778 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.113359 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.113563 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.113755 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.113948 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.114154 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.114352 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.114552 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.114759 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.114955 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.114955 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.115337 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.115532 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.115831 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.116031 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.116229 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.116425 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.116633 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.116821 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.117035 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.117251 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.117448 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.117645 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.117860 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.118055 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.118285 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.118495 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.118690 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.118885 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.119076 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.119290 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.119290 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.119724 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.119724 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.120131 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.120330 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.120556 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.120556 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.120926 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.121120 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.121392 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.121589 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.121808 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.122005 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.122202 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.122395 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.122589 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.122784 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.123002 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.123002 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.123401 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.123595 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.123787 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.123787 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.124165 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.124358 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.124571 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.124763 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.124958 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.124958 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.125477 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.125671 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.125884 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.126080 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.126273 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.126480 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.126678 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.127049 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.127249 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.127445 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.127654 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.127852 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.128049 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.128245 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.128438 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.128648 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.128854 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.128854 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.129492 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.129684 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.129877 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.130089 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.130299 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.130504 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.130701 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.130840 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.130974 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.130974 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.131236 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.131362 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.131486 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.131617 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.131739 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.131739 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.131996 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.131996 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.132256 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.132382 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.132506 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.132506 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.132760 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.132898 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.133023 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.133147 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.133309 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.133444 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.133568 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.133699 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.134350 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.134477 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.134611 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.134745 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.134870 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.134994 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.135125 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.135250 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.135250 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.135513 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.135639 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.135774 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.135774 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.136019 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.136144 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.136268 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.136400 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.136525 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.136649 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.136786 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.136922 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.137050 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.137213 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.137345 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.137471 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.137616 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.137743 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.137867 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.137991 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.138114 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.138246 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.138372 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.138497 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.138622 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.138752 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.138878 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.139019 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.139152 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.139277 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.139400 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.139540 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.139667 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.139804 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.139931 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.140061 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.140187 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.140301 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.140413 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.140528 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.140642 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.140749 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.140856 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.140945 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.141034 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.141119 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.141225 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.141305 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.141392 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.141479 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.141603 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.141712 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.141829 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.141917 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.142004 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.142153 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.142286 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.142394 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.142499 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.142605 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.142727 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.142831 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.142957 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.143064 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.143159 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.143240 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.143319 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.143405 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.143485 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.143562 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.143639 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.143753 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.143859 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.143965 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.144054 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.144183 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.144292 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.144386 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.144500 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.144596 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.144678 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.144762 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.144874 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.144961 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.145081 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.145230 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.145328 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.145421 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.145536 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.145623 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.145713 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.145799 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.145886 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.145966 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146044 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146121 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146216 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146296 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146374 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146459 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146538 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146639 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146739 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146820 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146907 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.146987 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.147066 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.147271 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 17:19:45.147409 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.147409 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.147409 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.147409 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.147409 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.147409 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.147409 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.147409 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.148315 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.148315 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:19:45.148315 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 17:19:45.148638 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG oslo_db.sqlalchemy.engines [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:19:45.148748 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_db.sqlalchemy.engines [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:19:45.211178 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.context [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15ce609a-5a92-491c-9260-447d239d1ed2(cell1) {{(pid=101852) load_cells /opt/stack/nova/nova/context.py:464}} Feb 08 17:19:45.211396 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.context [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15ce609a-5a92-491c-9260-447d239d1ed2(cell1) {{(pid=101851) load_cells /opt/stack/nova/nova/context.py:464}} Feb 08 17:19:45.215451 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:19:45.215567 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:19:45.217055 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:19:45.217148 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:19:45.217896 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:19:45.218019 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:19:45.219802 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:19:45.219894 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:19:45.231894 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG oslo_db.sqlalchemy.engines [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:19:45.237203 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_db.sqlalchemy.engines [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:19:45.238368 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG oslo_db.sqlalchemy.engines [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:19:45.240509 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_db.sqlalchemy.engines [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:19:45.395800 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG oslo_db.sqlalchemy.engines [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:19:45.398473 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_db.sqlalchemy.engines [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:19:45.740997 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: WARNING keystonemiddleware.auth_token [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 17:19:45.747728 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: WARNING keystonemiddleware.auth_token [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 17:19:45.983003 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: WARNING keystonemiddleware.auth_token [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 17:19:45.994646 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: WARNING keystonemiddleware.auth_token [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 17:19:46.087577 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: WARNING keystonemiddleware.auth_token [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 17:19:46.092951 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: WARNING keystonemiddleware.auth_token [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 17:19:46.098119 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562351a2b9c0 pid: 101851 (default app) Feb 08 17:19:46.100186 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:19:46.101389 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Feb 08 17:19:46.101798 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 788 bytes} [Tue Feb 8 17:19:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:19:46.522542 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: WARNING keystonemiddleware.auth_token [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 17:19:46.527993 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: WARNING keystonemiddleware.auth_token [None req-ae6a54b7-ad5c-460a-818f-9b81cbfa85ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 17:19:46.533170 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562351a2b9c0 pid: 101852 (default app) Feb 08 17:21:11.251250 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:11.252264 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Feb 08 17:21:11.252960 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:21:11.691379 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-dce12131-aad9-4318-8c27-64074c39d29d admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:11.721804 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-dce12131-aad9-4318-8c27-64074c39d29d admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.461726 Feb 08 17:21:11.722569 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 1/3] 10.222.0.69 () {60 vars in 1291 bytes} [Tue Feb 8 17:21:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:21:14.063057 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:14.064648 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-7e78ee0b-6160-4809-b538-0901e34da9a2 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Feb 08 17:21:14.065230 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 3/4] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:21:14.131639 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-5c7123a3-fc8b-45a4-ba37-79bc0948823d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:14.150679 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:21:14.150679 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: warnings.warn(msg) Feb 08 17:21:14.184531 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-5c7123a3-fc8b-45a4-ba37-79bc0948823d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112465 Feb 08 17:21:14.185100 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 2/5] 10.222.0.69 () {64 vars in 1282 bytes} [Tue Feb 8 17:21:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:21:14.402774 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-f26ee439-f157-46a2-9dd5-a92bf3f7977e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:14.405172 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:21:14.405172 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: warnings.warn(msg) Feb 08 17:21:14.455001 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-f26ee439-f157-46a2-9dd5-a92bf3f7977e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.261681 Feb 08 17:21:14.455768 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 4/6] 10.222.0.69 () {64 vars in 1335 bytes} [Tue Feb 8 17:21:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:21:16.734195 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-5c7123a3-fc8b-45a4-ba37-79bc0948823d admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:16.735768 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-5c7123a3-fc8b-45a4-ba37-79bc0948823d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Feb 08 17:21:16.736348 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 3/7] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:21:16.854366 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-0a6c80ee-7fc6-45fb-bae1-acfaae27efdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "ram": 512, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:16.882568 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:21:16.882568 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: warnings.warn(msg) Feb 08 17:21:16.902375 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-0a6c80ee-7fc6-45fb-bae1-acfaae27efdd admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159944 Feb 08 17:21:16.903464 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 5/8] 10.222.0.69 () {64 vars in 1282 bytes} [Tue Feb 8 17:21:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:21:16.915339 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-eb9c7658-5cb7-4c2e-a5c9-82b0fade07bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:16.916882 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:21:16.916882 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: warnings.warn(msg) Feb 08 17:21:16.948828 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-eb9c7658-5cb7-4c2e-a5c9-82b0fade07bb admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037010 Feb 08 17:21:16.949460 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 4/9] 10.222.0.69 () {64 vars in 1335 bytes} [Tue Feb 8 17:21:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:21:19.243563 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-0a6c80ee-7fc6-45fb-bae1-acfaae27efdd admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:19.244583 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-0a6c80ee-7fc6-45fb-bae1-acfaae27efdd admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Feb 08 17:21:19.245534 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:21:19.307883 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-f608384e-d154-4cf4-b5cd-beb8d52abab8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:19.328956 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-f608384e-d154-4cf4-b5cd-beb8d52abab8 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076399 Feb 08 17:21:19.339230 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 5/11] 10.222.0.69 () {64 vars in 1282 bytes} [Tue Feb 8 17:21:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:21:19.344511 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-ee63c50a-2b20-4e2c-a41e-290c3110b99c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:19.369299 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-ee63c50a-2b20-4e2c-a41e-290c3110b99c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028637 Feb 08 17:21:19.370234 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 7/12] 10.222.0.69 () {64 vars in 1335 bytes} [Tue Feb 8 17:21:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:21:21.676481 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-f608384e-d154-4cf4-b5cd-beb8d52abab8 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:21.677569 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-f608384e-d154-4cf4-b5cd-beb8d52abab8 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Feb 08 17:21:21.677987 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 6/13] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:21:21.739851 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-efd3e848-2095-450e-947b-739edece4f54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds2G"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:21.758761 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-efd3e848-2095-450e-947b-739edece4f54 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074135 Feb 08 17:21:21.759320 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 8/14] 10.222.0.69 () {64 vars in 1282 bytes} [Tue Feb 8 17:21:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:21:21.771389 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-a831c00c-f50c-4f82-ab24-58bd9ba6cfb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:21.793794 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-a831c00c-f50c-4f82-ab24-58bd9ba6cfb0 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025907 Feb 08 17:21:21.794644 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 7/15] 10.222.0.69 () {64 vars in 1335 bytes} [Tue Feb 8 17:21:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:21:24.130518 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-efd3e848-2095-450e-947b-739edece4f54 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:24.131675 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-efd3e848-2095-450e-947b-739edece4f54 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Feb 08 17:21:24.132327 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 9/16] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:21:24.197190 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-10f143f9-baf4-4564-a231-a7585a55f675 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0}} {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:24.216875 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-10f143f9-baf4-4564-a231-a7585a55f675 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078247 Feb 08 17:21:24.217764 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 8/17] 10.222.0.69 () {64 vars in 1282 bytes} [Tue Feb 8 17:21:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 17:21:24.230043 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-8dd56c8f-228e-4b37-afce-1368e326dca2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:24.253970 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-8dd56c8f-228e-4b37-afce-1368e326dca2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027490 Feb 08 17:21:24.254703 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 10/18] 10.222.0.69 () {64 vars in 1335 bytes} [Tue Feb 8 17:21:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:21:26.555260 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-10f143f9-baf4-4564-a231-a7585a55f675 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:26.556253 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-10f143f9-baf4-4564-a231-a7585a55f675 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Feb 08 17:21:26.556651 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 9/19] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:21:26.616402 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-93a9dc58-e110-4bc7-8449-b11f37607f32 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:26.644381 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-93a9dc58-e110-4bc7-8449-b11f37607f32 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081473 Feb 08 17:21:26.645322 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 11/20] 10.222.0.69 () {60 vars in 1291 bytes} [Tue Feb 8 17:21:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:21:28.953567 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-10f143f9-baf4-4564-a231-a7585a55f675 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:28.955686 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-10f143f9-baf4-4564-a231-a7585a55f675 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002835 Feb 08 17:21:28.956548 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 10/21] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:28 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:21:29.032712 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-741eaff4-f394-4347-95e4-dafef6cb50a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:29.066758 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-741eaff4-f394-4347-95e4-dafef6cb50a3 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.102760 Feb 08 17:21:29.068317 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 12/22] 10.222.0.69 () {64 vars in 1282 bytes} [Tue Feb 8 17:21:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 17:21:29.080104 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-4c7d2fb8-cfcf-4b0f-b545-0ed05065da08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:29.104776 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-4c7d2fb8-cfcf-4b0f-b545-0ed05065da08 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028349 Feb 08 17:21:29.105399 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 11/23] 10.222.0.69 () {64 vars in 1332 bytes} [Tue Feb 8 17:21:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:21:31.656937 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-741eaff4-f394-4347-95e4-dafef6cb50a3 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:31.657990 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-741eaff4-f394-4347-95e4-dafef6cb50a3 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Feb 08 17:21:31.658398 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 13/24] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:21:31.718628 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-4d3fa5eb-3631-4bb5-8463-f3234e8cf4e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "disk": 20, "vcpus": 1, "id": "2", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:31.738138 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-4d3fa5eb-3631-4bb5-8463-f3234e8cf4e7 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073483 Feb 08 17:21:31.738664 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 12/25] 10.222.0.69 () {64 vars in 1282 bytes} [Tue Feb 8 17:21:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:21:31.750244 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-4aed829a-4e85-4e44-86dd-28540345424a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:31.772301 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-4aed829a-4e85-4e44-86dd-28540345424a admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025762 Feb 08 17:21:31.772880 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 14/26] 10.222.0.69 () {64 vars in 1332 bytes} [Tue Feb 8 17:21:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:21:34.121898 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-4d3fa5eb-3631-4bb5-8463-f3234e8cf4e7 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:34.122919 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-4d3fa5eb-3631-4bb5-8463-f3234e8cf4e7 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Feb 08 17:21:34.123602 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:21:34.193846 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-af65475b-02b2-4de7-b00a-169df17da699 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:34.214642 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-af65475b-02b2-4de7-b00a-169df17da699 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.083371 Feb 08 17:21:34.216312 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 15/28] 10.222.0.69 () {64 vars in 1282 bytes} [Tue Feb 8 17:21:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:21:34.228704 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-1f8e0b1e-4dab-41ce-a071-5803f76e615c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:34.252095 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-1f8e0b1e-4dab-41ce-a071-5803f76e615c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027347 Feb 08 17:21:34.253720 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 14/29] 10.222.0.69 () {64 vars in 1332 bytes} [Tue Feb 8 17:21:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:21:36.519003 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-af65475b-02b2-4de7-b00a-169df17da699 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:36.520007 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-af65475b-02b2-4de7-b00a-169df17da699 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002344 Feb 08 17:21:36.520415 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 16/30] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:21:36.578661 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-4dc8c7cd-d3f2-4134-9aa8-643949f76c26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "vcpus": 4}} {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:36.597723 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-4dc8c7cd-d3f2-4134-9aa8-643949f76c26 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071504 Feb 08 17:21:36.598266 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 15/31] 10.222.0.69 () {64 vars in 1282 bytes} [Tue Feb 8 17:21:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 17:21:36.609835 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-9a7f8c4e-4c8f-440b-9abe-74637b05703e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:36.633889 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-9a7f8c4e-4c8f-440b-9abe-74637b05703e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027662 Feb 08 17:21:36.634564 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 17/32] 10.222.0.69 () {64 vars in 1332 bytes} [Tue Feb 8 17:21:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:21:38.911899 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-4dc8c7cd-d3f2-4134-9aa8-643949f76c26 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:21:38.912904 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-4dc8c7cd-d3f2-4134-9aa8-643949f76c26 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Feb 08 17:21:38.913792 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 16/33] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:21:38.974914 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-f698726d-56fc-4dda-a381-1d01358dea23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:38.994102 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-f698726d-56fc-4dda-a381-1d01358dea23 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074539 Feb 08 17:21:39.001734 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 18/34] 10.222.0.69 () {64 vars in 1282 bytes} [Tue Feb 8 17:21:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:21:39.006850 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-e7e2bc27-1d46-4ad2-b2fb-507d0072108e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:21:39.035443 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-e7e2bc27-1d46-4ad2-b2fb-507d0072108e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032237 Feb 08 17:21:39.057192 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 17/35] 10.222.0.69 () {64 vars in 1332 bytes} [Tue Feb 8 17:21:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:22:03.043322 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-f698726d-56fc-4dda-a381-1d01358dea23 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:03.044443 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-f698726d-56fc-4dda-a381-1d01358dea23 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Feb 08 17:22:03.044845 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 19/36] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:22:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:22:03.114082 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-7a6fe9a0-5074-4bb6-92ec-f47c83b72f0e admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:03.134320 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-7a6fe9a0-5074-4bb6-92ec-f47c83b72f0e admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.083149 Feb 08 17:22:03.135135 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1291 bytes} [Tue Feb 8 17:22:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:22:04.533005 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-f698726d-56fc-4dda-a381-1d01358dea23 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:04.534045 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-f698726d-56fc-4dda-a381-1d01358dea23 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Feb 08 17:22:04.534471 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 20/38] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:22:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:22:04.730022 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-2d853e69-d2a7-4111-8fe0-fc3fa32c0f01 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:04.735459 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.wsgi [None req-2d853e69-d2a7-4111-8fe0-fc3fa32c0f01 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 08 17:22:04.736025 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-2d853e69-d2a7-4111-8fe0-fc3fa32c0f01 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:22:04.736828 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-2d853e69-d2a7-4111-8fe0-fc3fa32c0f01 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058902 Feb 08 17:22:04.737364 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1190 bytes} [Tue Feb 8 17:22:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 08 17:22:04.747253 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-f42b85af-98aa-4b89-84bb-15952fb88583 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:04.767429 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-f42b85af-98aa-4b89-84bb-15952fb88583 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023743 Feb 08 17:22:04.767990 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 21/40] 10.222.0.69 () {60 vars in 1210 bytes} [Tue Feb 8 17:22:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:22:04.777900 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-adc25303-e612-4dd8-a4ab-96ba23ec3dd6 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:04.799078 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-adc25303-e612-4dd8-a4ab-96ba23ec3dd6 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024732 Feb 08 17:22:04.799614 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 20/41] 10.222.0.69 () {60 vars in 1210 bytes} [Tue Feb 8 17:22:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:22:04.809777 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-897306a0-786a-49b8-b27f-982ee53293c8 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:04.815137 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.wsgi [None req-897306a0-786a-49b8-b27f-982ee53293c8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 08 17:22:04.815701 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-897306a0-786a-49b8-b27f-982ee53293c8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:22:04.816484 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-897306a0-786a-49b8-b27f-982ee53293c8 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010295 Feb 08 17:22:04.816979 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 22/42] 10.222.0.69 () {60 vars in 1190 bytes} [Tue Feb 8 17:22:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 08 17:22:06.213456 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-adc25303-e612-4dd8-a4ab-96ba23ec3dd6 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:06.214644 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-adc25303-e612-4dd8-a4ab-96ba23ec3dd6 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Feb 08 17:22:06.215095 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 21/43] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:22:06.434623 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-02948d3f-8aa3-437d-ae80-0f28e8d4ec6c admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:06.440301 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.wsgi [None req-02948d3f-8aa3-437d-ae80-0f28e8d4ec6c admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 08 17:22:06.440852 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-02948d3f-8aa3-437d-ae80-0f28e8d4ec6c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:22:06.441673 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-02948d3f-8aa3-437d-ae80-0f28e8d4ec6c admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058437 Feb 08 17:22:06.442172 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 23/44] 10.222.0.69 () {60 vars in 1190 bytes} [Tue Feb 8 17:22:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 08 17:22:06.451424 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-9eef4e4c-73ab-4c49-9bcf-e3a81209408d admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:06.466057 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-9eef4e4c-73ab-4c49-9bcf-e3a81209408d admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018133 Feb 08 17:22:06.466579 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 22/45] 10.222.0.69 () {60 vars in 1210 bytes} [Tue Feb 8 17:22:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:22:06.476281 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-8dbfadd1-391e-4468-a52d-3fd7ff68a78b admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:06.489528 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-8dbfadd1-391e-4468-a52d-3fd7ff68a78b admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017121 Feb 08 17:22:06.490680 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1210 bytes} [Tue Feb 8 17:22:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:22:06.499716 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-93492c56-ada3-4fe0-8125-f9d2648946b2 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:06.504768 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.wsgi [None req-93492c56-ada3-4fe0-8125-f9d2648946b2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 08 17:22:06.505368 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-93492c56-ada3-4fe0-8125-f9d2648946b2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:22:06.506173 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-93492c56-ada3-4fe0-8125-f9d2648946b2 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010008 Feb 08 17:22:06.506649 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 23/47] 10.222.0.69 () {60 vars in 1190 bytes} [Tue Feb 8 17:22:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 08 17:22:07.817831 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-8dbfadd1-391e-4468-a52d-3fd7ff68a78b admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:07.819016 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-8dbfadd1-391e-4468-a52d-3fd7ff68a78b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001757 Feb 08 17:22:07.819500 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 25/48] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:22:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:22:08.032499 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-25e37680-437d-41d4-bdc1-f9e7b614cad1 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:08.038507 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.wsgi [None req-25e37680-437d-41d4-bdc1-f9e7b614cad1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 08 17:22:08.039070 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-25e37680-437d-41d4-bdc1-f9e7b614cad1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:22:08.039863 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-25e37680-437d-41d4-bdc1-f9e7b614cad1 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058499 Feb 08 17:22:08.040383 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 24/49] 10.222.0.69 () {60 vars in 1193 bytes} [Tue Feb 8 17:22:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 08 17:22:08.049839 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-81e3c5b5-6971-4421-80c7-99a1aa053fe7 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:08.065015 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-81e3c5b5-6971-4421-80c7-99a1aa053fe7 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018653 Feb 08 17:22:08.065644 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 26/50] 10.222.0.69 () {60 vars in 1210 bytes} [Tue Feb 8 17:22:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:22:08.075485 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:08.088880 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017372 Feb 08 17:22:08.089433 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 25/51] 10.222.0.69 () {60 vars in 1210 bytes} [Tue Feb 8 17:22:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:22:08.098443 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-3d43d362-da23-4585-9e9c-021986bbf075 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:08.104232 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.wsgi [None req-3d43d362-da23-4585-9e9c-021986bbf075 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 08 17:22:08.104787 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-3d43d362-da23-4585-9e9c-021986bbf075 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:22:08.105592 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-3d43d362-da23-4585-9e9c-021986bbf075 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010644 Feb 08 17:22:08.106076 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1193 bytes} [Tue Feb 8 17:22:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 08 17:22:09.384575 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:09.385695 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Feb 08 17:22:09.386172 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:22:09.586649 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-ebaa36d8-b3b2-4747-aab4-93762b5369bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:22:09.605992 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-ebaa36d8-b3b2-4747-aab4-93762b5369bb admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.077662 Feb 08 17:22:09.606546 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 28/54] 10.222.0.69 () {64 vars in 1235 bytes} [Tue Feb 8 17:22:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:22:10.885508 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:10.886512 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Feb 08 17:22:10.886902 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 27/55] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:22:11.077010 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-c8a3895c-cdca-4c15-9d81-ae094a0360cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:22:11.094060 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-c8a3895c-cdca-4c15-9d81-ae094a0360cc admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068799 Feb 08 17:22:11.094655 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 29/56] 10.222.0.69 () {64 vars in 1235 bytes} [Tue Feb 8 17:22:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:22:12.371921 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:12.372929 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Feb 08 17:22:12.373356 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 28/57] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:22:12.569663 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-3fe2c12f-1e20-438d-99c9-023db933739c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:22:12.587206 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-3fe2c12f-1e20-438d-99c9-023db933739c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072774 Feb 08 17:22:12.587674 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 30/58] 10.222.0.69 () {64 vars in 1235 bytes} [Tue Feb 8 17:22:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 17:22:13.865345 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:13.866382 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Feb 08 17:22:13.866775 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 29/59] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:22:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:22:14.062309 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-768294f0-7c8e-4b91-aba4-8a5ec8c4e915 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:22:14.079976 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-768294f0-7c8e-4b91-aba4-8a5ec8c4e915 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072124 Feb 08 17:22:14.080523 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 31/60] 10.222.0.69 () {64 vars in 1235 bytes} [Tue Feb 8 17:22:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:22:15.363374 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:15.364377 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Feb 08 17:22:15.364771 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 30/61] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:22:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:22:15.556919 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-c391c906-b63b-4ee7-980c-e93eca818160 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:22:15.576304 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-c391c906-b63b-4ee7-980c-e93eca818160 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070738 Feb 08 17:22:15.576770 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 32/62] 10.222.0.69 () {60 vars in 1202 bytes} [Tue Feb 8 17:22:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:23:02.574122 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:23:02.575125 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-8a7ae3b3-c6ba-4c81-b0cb-b5990fbb8673 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Feb 08 17:23:02.575528 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 31/63] 10.222.0.69 () {54 vars in 930 bytes} [Tue Feb 8 17:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:23:02.633875 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-2ec5c1e0-3954-453b-a4c1-50045e61228e admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:23:02.655522 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-2ec5c1e0-3954-453b-a4c1-50045e61228e admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073804 Feb 08 17:23:02.656152 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 33/64] 10.222.0.69 () {60 vars in 1291 bytes} [Tue Feb 8 17:23:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:23:02.685775 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-72d59c90-c0b7-4cc1-8a40-026904d3b812 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:23:02.694078 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-72d59c90-c0b7-4cc1-8a40-026904d3b812 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012336 Feb 08 17:23:02.694630 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 32/65] 10.222.0.69 () {60 vars in 1282 bytes} [Tue Feb 8 17:23:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:23:02.707369 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-fbc01ce9-4d27-4509-9a0b-503bf43e0e85 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:23:02.717289 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-fbc01ce9-4d27-4509-9a0b-503bf43e0e85 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013849 Feb 08 17:23:02.718226 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 34/66] 10.222.0.69 () {60 vars in 1285 bytes} [Tue Feb 8 17:23:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:23:02.729644 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-a6302ed8-306d-4bed-a082-f0c901b31b58 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:23:02.737794 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-a6302ed8-306d-4bed-a082-f0c901b31b58 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011582 Feb 08 17:23:02.738355 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1285 bytes} [Tue Feb 8 17:23:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:23:02.750446 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-a7bf47af-8b36-4121-a5fe-995c586d6889 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:23:02.759907 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-a7bf47af-8b36-4121-a5fe-995c586d6889 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013030 Feb 08 17:23:02.760373 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 35/68] 10.222.0.69 () {60 vars in 1282 bytes} [Tue Feb 8 17:23:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:24:30.615303 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-ca6fa2fe-1957-4a42-9525-40e4cc7239d4 tempest-verify_tempest_config-1093488292 tempest-verify_tempest_config-1093488292-project] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:24:30.617628 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-ca6fa2fe-1957-4a42-9525-40e4cc7239d4 tempest-verify_tempest_config-1093488292 tempest-verify_tempest_config-1093488292-project] 10.222.0.69 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.112336 Feb 08 17:24:30.618163 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 34/69] 10.222.0.69 () {58 vars in 1133 bytes} [Tue Feb 8 17:24:30 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:26:06.241183 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-a7bf47af-8b36-4121-a5fe-995c586d6889 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:26:06.242517 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-a7bf47af-8b36-4121-a5fe-995c586d6889 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 Feb 08 17:26:06.243138 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 36/70] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:26:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:26:06.553818 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-a5c43943-d12b-4644-a7e5-2364635fdda9 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:26:06.555055 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:26:06.555055 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: warnings.warn(msg) Feb 08 17:26:06.556889 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-a5c43943-d12b-4644-a7e5-2364635fdda9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:26:06.557436 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-a5c43943-d12b-4644-a7e5-2364635fdda9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:26:06.558314 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-a5c43943-d12b-4644-a7e5-2364635fdda9 admin admin] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:26:06.558799 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-a5c43943-d12b-4644-a7e5-2364635fdda9 admin admin] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:26:06.604326 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-a5c43943-d12b-4644-a7e5-2364635fdda9 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208658 Feb 08 17:26:06.604988 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 35/71] 10.222.0.69 () {60 vars in 1193 bytes} [Tue Feb 8 17:26:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:26:08.002283 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-a7bf47af-8b36-4121-a5fe-995c586d6889 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:26:08.003289 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-a7bf47af-8b36-4121-a5fe-995c586d6889 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Feb 08 17:26:08.003697 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 37/72] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:26:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:26:08.219050 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-71151a43-35b5-46b1-bc15-35336563f407 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:26:08.220217 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:26:08.220217 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: warnings.warn(msg) Feb 08 17:26:08.221830 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-71151a43-35b5-46b1-bc15-35336563f407 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:26:08.222799 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-71151a43-35b5-46b1-bc15-35336563f407 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:26:08.223086 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-71151a43-35b5-46b1-bc15-35336563f407 admin admin] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:26:08.223517 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-71151a43-35b5-46b1-bc15-35336563f407 admin admin] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:26:08.244092 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-71151a43-35b5-46b1-bc15-35336563f407 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.088264 Feb 08 17:26:08.245253 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 36/73] 10.222.0.69 () {60 vars in 1193 bytes} [Tue Feb 8 17:26:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:26:20.068675 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-a7bf47af-8b36-4121-a5fe-995c586d6889 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:26:20.069748 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-a7bf47af-8b36-4121-a5fe-995c586d6889 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Feb 08 17:26:20.070141 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 38/74] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:26:20.265475 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-75aa640a-cb06-47e1-84a4-73dd315129f3 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:26:20.267087 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:26:20.267087 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: warnings.warn(msg) Feb 08 17:26:20.269373 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-75aa640a-cb06-47e1-84a4-73dd315129f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:26:20.269815 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-75aa640a-cb06-47e1-84a4-73dd315129f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:26:20.270611 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-75aa640a-cb06-47e1-84a4-73dd315129f3 admin admin] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:26:20.271037 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-75aa640a-cb06-47e1-84a4-73dd315129f3 admin admin] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:26:20.297165 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-75aa640a-cb06-47e1-84a4-73dd315129f3 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088340 Feb 08 17:26:20.297749 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 37/75] 10.222.0.69 () {60 vars in 1193 bytes} [Tue Feb 8 17:26:20 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:26:21.604131 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-a7bf47af-8b36-4121-a5fe-995c586d6889 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:26:21.605114 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-a7bf47af-8b36-4121-a5fe-995c586d6889 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Feb 08 17:26:21.605532 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 39/76] 10.222.0.69 () {56 vars in 1074 bytes} [Tue Feb 8 17:26:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:26:21.802160 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG nova.api.openstack.wsgi [None req-dd837614-6eea-4094-951d-5f3a03f38a73 admin admin] Calling method '>' {{(pid=101852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:26:21.803299 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:26:21.803299 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: warnings.warn(msg) Feb 08 17:26:21.804851 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-dd837614-6eea-4094-951d-5f3a03f38a73 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:26:21.805320 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-dd837614-6eea-4094-951d-5f3a03f38a73 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:26:21.806111 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-dd837614-6eea-4094-951d-5f3a03f38a73 admin admin] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:26:21.806564 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: DEBUG oslo_concurrency.lockutils [None req-dd837614-6eea-4094-951d-5f3a03f38a73 admin admin] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:26:21.828116 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: INFO nova.api.openstack.requestlog [None req-dd837614-6eea-4094-951d-5f3a03f38a73 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079091 Feb 08 17:26:21.829022 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: [pid: 101852|app: 0|req: 38/77] 10.222.0.69 () {60 vars in 1193 bytes} [Tue Feb 8 17:26:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:27:21.283096 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: Tue Feb 8 17:27:21 2022 - graceful shutdown triggered... Feb 08 17:27:21.283234 dv-cinder-822040-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 08 17:27:21.284437 dv-cinder-822040-2-iscsi devstack@n-api.service[101851]: Gracefully killing worker 1 (pid: 101851)... Feb 08 17:27:21.284829 dv-cinder-822040-2-iscsi devstack@n-api.service[101852]: Gracefully killing worker 2 (pid: 101852)... Feb 08 17:27:22.285412 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: worker 1 buried after 1 seconds Feb 08 17:27:22.285412 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: worker 2 buried after 1 seconds Feb 08 17:27:22.285412 dv-cinder-822040-2-iscsi devstack@n-api.service[101850]: goodbye to uWSGI. Feb 08 17:27:22.287018 dv-cinder-822040-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 08 17:27:22.287591 dv-cinder-822040-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 08 17:27:22.290442 dv-cinder-822040-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 08 17:27:22.305320 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 08 17:27:22.307283 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 8 17:27:22 2022] *** Feb 08 17:27:22.307283 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 08 17:27:22.307283 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 08 17:27:22.307283 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: nodename: dv-cinder-822040-2-iscsi Feb 08 17:27:22.307283 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: machine: x86_64 Feb 08 17:27:22.307283 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: clock source: unix Feb 08 17:27:22.307283 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: pcre jit disabled Feb 08 17:27:22.307283 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: detected number of CPU cores: 4 Feb 08 17:27:22.307283 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: current working directory: / Feb 08 17:27:22.307283 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: detected binary path: /usr/bin/uwsgi-core Feb 08 17:27:22.308052 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: your processes number limit is 47680 Feb 08 17:27:22.308052 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: your memory page size is 4096 bytes Feb 08 17:27:22.308052 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: detected max file descriptor number: 2048 Feb 08 17:27:22.308052 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: lock engine: pthread robust mutexes Feb 08 17:27:22.308052 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: thunder lock: enabled Feb 08 17:27:22.308052 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 08 17:27:22.308052 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 08 17:27:22.355724 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: Python main interpreter initialized at 0x55cbe884a9c0 Feb 08 17:27:22.355724 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: python threads support enabled Feb 08 17:27:22.355724 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: your server socket listen backlog is limited to 100 connections Feb 08 17:27:22.355724 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: your mercy for graceful operations on workers is 90 seconds Feb 08 17:27:22.356177 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: mapped 403077 bytes (393 KB) for 2 cores Feb 08 17:27:22.356177 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: *** Operational MODE: preforking *** Feb 08 17:27:22.356435 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: *** uWSGI is running in multiple interpreter mode *** Feb 08 17:27:22.356435 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: spawned uWSGI master process (pid: 116466) Feb 08 17:27:22.356638 dv-cinder-822040-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 08 17:27:22.357843 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: spawned uWSGI worker 1 (pid: 116479, cores: 1) Feb 08 17:27:22.357843 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: spawned uWSGI worker 2 (pid: 116480, cores: 1) Feb 08 17:27:22.357843 dv-cinder-822040-2-iscsi devstack@n-api.service[116466]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 08 17:27:24.327472 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 17:27:24.327472 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: from cryptography.utils import int_from_bytes Feb 08 17:27:24.328149 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 17:27:24.328149 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: from cryptography.utils import int_from_bytes Feb 08 17:27:24.344450 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 17:27:24.344450 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: from cryptography.utils import int_from_bytes Feb 08 17:27:24.345092 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 17:27:24.345092 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: from cryptography.utils import int_from_bytes Feb 08 17:27:26.763908 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 17:27:26.764489 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 17:27:26.764682 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 17:27:26.765043 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 17:27:26.765333 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 17:27:26.765730 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.766060 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.766384 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.766745 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.767058 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.767372 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.768210 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.768210 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.768380 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.768654 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.768909 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.769268 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822040-2-iscsi {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.769598 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.769911 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.770232 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.770556 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.770864 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.771189 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.771501 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.772129 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.772662 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.773131 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.773621 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.774114 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.774456 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.774771 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.775096 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.775413 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.775747 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.776064 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.776477 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822040-2-iscsi {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.776817 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.777256 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.777921 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.778034 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.778304 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.778617 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.778944 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.779285 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.779602 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.779932 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.780263 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.780586 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.780938 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.781241 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.781558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.781877 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.782202 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.782510 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.782818 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.783074 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.783385 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.783711 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.784036 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.784362 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.784620 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.784876 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.785222 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.785551 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.785867 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.786180 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.786494 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.786805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.787116 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.787428 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.787741 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.788086 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.788414 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.788735 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.789064 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.789400 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.789731 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.790137 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.790399 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.790711 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.791056 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.791377 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.791687 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.792013 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.792338 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.792649 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.792963 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.793337 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.793732 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.794070 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.794406 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.794630 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.794938 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.795251 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.795576 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.795888 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.796198 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.796511 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.796816 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.797131 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.797471 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.797798 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.798093 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.801859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.801859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.801859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.801859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.801859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.801859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.801859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.801859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.802483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.802483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.802483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.802483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.802483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.802483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.802883 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.802961 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.803307 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.804149 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.804468 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.804782 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.805110 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.805438 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.805774 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.806075 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.806391 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.806702 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.807012 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.807321 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.807631 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.807958 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.808249 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.808559 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.808923 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.809369 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.809976 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.810155 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.810418 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.810738 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.811065 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.811413 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.811751 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.812099 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.812421 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.812758 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.813095 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.813453 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.813768 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.814089 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.814427 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.814759 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.815073 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.815392 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.815713 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.816039 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.816375 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.816701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.817038 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.817378 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.817696 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.818020 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.818354 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.818692 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.819004 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.819928 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.820283 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.820607 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.820944 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.821295 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.821615 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.821934 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.822252 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.822584 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.822925 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.823244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.823568 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.823885 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.824203 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.824521 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.825018 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.825472 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.825674 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.826168 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.826340 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.826491 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 17:27:26.827001 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.827162 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 17:27:26.827326 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.827326 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.827597 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 17:27:26.827739 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.827888 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 17:27:26.828038 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.828180 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 17:27:26.828320 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.828460 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.828610 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.828765 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.828915 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.829068 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.829274 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.829566 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.829717 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.829872 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.830022 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.830164 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.830312 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.830460 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.830610 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.830754 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.830912 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.831166 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.831326 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.831468 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.831625 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.831769 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.831916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.832065 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822040-2-iscsi {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.832214 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.832356 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.832506 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.832654 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.832798 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.832940 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.833081 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.833272 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.833426 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.833585 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.833835 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.833991 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.834134 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.834283 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.834431 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.834431 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.834717 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.834891 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.835271 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.835530 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.835690 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.835843 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.836007 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.836489 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.836651 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.836794 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.836935 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.837085 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.837281 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.837425 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.837580 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.837733 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.837874 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.838015 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.838165 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.838314 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.838471 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.838613 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.838762 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822040-2-iscsi {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.838904 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.839045 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.839200 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.839350 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.839509 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.839794 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.840064 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.840302 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.840467 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.840639 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.840845 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.840999 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.841174 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.841441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.841590 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.841745 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.841896 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.842050 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.842192 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.842343 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.842492 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.842635 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.842776 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.842916 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.843065 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.843216 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.843365 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.843507 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.843648 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.844234 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.844411 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.844554 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.844695 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.844836 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.844984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.845126 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.845540 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.845692 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.845834 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.845975 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.846116 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.846707 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.846894 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.847047 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.847217 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.847501 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.847664 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.847816 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.847976 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.848119 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.848119 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.848405 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.848549 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.848701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.848863 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.849014 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.849195 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.849359 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.849510 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.849661 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.849835 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.850117 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.850267 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.850965 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.851172 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.851336 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.851616 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.851786 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.851931 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.852074 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.852216 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.852365 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.852524 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.852675 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.852819 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.852962 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.853112 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.853299 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.853444 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.853593 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.853755 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.853898 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.854047 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.854221 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.854483 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.854640 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.854790 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.854942 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.855092 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.855333 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.855711 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.855862 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.856016 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.856167 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.856309 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.856464 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.857003 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.857175 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.857334 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.857477 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.857633 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.857829 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.857979 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.858159 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.858382 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.858602 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.858759 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.859174 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.859326 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.859469 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.859612 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.859766 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.859917 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.860068 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.860384 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.860541 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.860898 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.861224 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.861409 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.861570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.861820 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.861974 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.862123 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.862267 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.862425 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.862569 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.862711 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.862711 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.862978 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.863128 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.863272 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.863431 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.863580 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.863723 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.863864 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.864019 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.864162 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.864352 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.864624 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.864842 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.865013 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.865197 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.865359 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.865511 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.865890 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.866685 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.867037 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.867338 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.867491 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.867633 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.867790 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.867939 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.868095 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.868245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.868394 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.868546 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.868700 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.868849 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.868998 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.869139 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.869388 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.869550 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.869693 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.869835 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.869983 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.870133 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.870283 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.870574 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.870726 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.870892 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.871034 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.871195 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.871462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.871745 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.879162 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.879406 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.879570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.879720 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.879885 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.880040 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.880194 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.880339 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.880505 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.880847 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.880847 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.881279 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.881462 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.881726 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.881902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.882069 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.882214 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.882374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.882639 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.882794 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.882941 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.883121 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.883266 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.883408 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.883550 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.883706 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.883849 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.883999 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.884225 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.884377 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.884528 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.884671 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.884820 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.884975 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.885137 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 17:27:26.885324 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.885475 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.885617 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.885617 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.885903 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.886302 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.886462 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.886612 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.886754 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.886909 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.887052 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.887212 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.887367 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.887510 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.887651 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.887805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.887954 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.888103 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.888245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.888387 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.888570 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.888570 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.889109 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.889441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.889611 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.889755 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.889984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.890128 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.890280 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.890423 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.890566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.890715 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.891024 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.891174 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.891317 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.891466 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.891628 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.891902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.892133 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.892285 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.892427 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.892575 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.892850 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.893006 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.893187 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.893348 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.893491 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.893646 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.893795 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.893947 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.894096 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.894238 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.894380 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.894529 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.894673 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.894815 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.894956 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.895104 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.895280 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.905823 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.905823 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.906892 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.907048 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.907206 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.907354 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.907498 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.907650 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.907794 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.907936 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.908087 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.908230 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.908371 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.908512 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.908653 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.908811 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.908962 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.909105 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.909331 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.909475 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.909615 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.909766 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.909917 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.910059 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.910199 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.910348 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.910499 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.910656 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.910813 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.910963 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.911106 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.911247 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.911459 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.911616 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.911780 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.912273 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.912424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.912577 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.912739 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.914031 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.914207 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.914357 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.914513 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.914662 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.914662 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.914953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.915107 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.915107 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.915428 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.915591 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.915755 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.915911 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.915911 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.916212 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.916368 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.916368 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.916658 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.916815 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.916815 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.917096 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.917294 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.917444 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.917601 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.917601 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.917898 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.918131 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.918131 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.918449 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.918606 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.918606 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.918903 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.919051 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.919051 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.919350 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.919548 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.919747 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.919933 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.919933 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.920243 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.920414 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.920414 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.920704 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.920891 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.920891 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.921252 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.921421 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.921572 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.921721 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.921721 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.922018 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.922494 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.922494 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.922816 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.922973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.922973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.923265 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.923434 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.923936 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.924458 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.924458 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.924754 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.924903 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.924903 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.925255 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.925431 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.925590 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.925745 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.925903 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.926061 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.926218 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.926384 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.926633 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.926789 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.926789 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.927086 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.927243 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.927420 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.927600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.927750 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.927920 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.928081 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.928240 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.928397 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.929196 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.929370 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.929535 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.929686 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.929842 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.929991 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.930147 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.930309 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.930542 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.930542 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.930844 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.930994 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.931149 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.931306 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.931488 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.931647 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.931796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.931944 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.932096 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.932291 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.932788 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.932949 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.933098 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.933287 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.933447 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.933612 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.934102 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.934279 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.934581 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.934908 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.935075 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.935318 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.935519 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.935680 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.935913 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.936149 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.936337 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.936602 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.936761 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.936918 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.937074 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.937305 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.937468 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.937626 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.937776 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.937776 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.938079 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.938079 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.938374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.938374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.938737 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.938737 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.939027 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.939176 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.939333 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.939511 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.939660 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.939817 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.939985 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.940184 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.940351 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.940510 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.940703 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.940858 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.941007 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.941175 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.941344 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.941506 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.941655 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.941803 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.941959 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.942127 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.942276 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.942430 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.942606 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.943097 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.943268 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.943457 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.943615 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.943764 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.943930 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.944424 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.944601 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.944920 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.945361 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.945521 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.945682 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.945850 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.946180 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.946346 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.946496 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.946645 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.946794 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.946944 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.947108 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.947438 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.947626 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.947782 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.947931 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.948090 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.948255 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.948407 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.948556 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.948705 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.948869 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.949020 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.949224 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.949394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.949545 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.949714 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.949864 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.950020 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.950182 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.950333 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.950488 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.950644 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.950800 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.950957 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.951107 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.951263 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.951440 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.951596 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.951758 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.951916 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.952066 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.952222 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.952373 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.952522 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.952679 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.953243 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.953417 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.953581 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.953738 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.953894 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.953894 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.954244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.954714 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.954898 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.955212 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.955532 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.955707 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.955859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.956009 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.956166 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.956323 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.956473 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.956635 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.956797 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.956946 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.957101 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.957354 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.957519 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.957683 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.957837 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.957997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.958145 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.958301 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.958451 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.958613 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.958762 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.958929 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.959086 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.959234 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.959409 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.959578 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.959758 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.959912 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.960062 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.960219 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.960377 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.960534 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.960683 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.960831 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.960998 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.961175 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.961345 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.961504 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.961652 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.961808 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.961958 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.962113 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.962274 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.962424 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.962572 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.962728 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.962877 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.963069 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.963495 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.963595 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.963679 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.963769 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.963852 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.963942 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.964020 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.964097 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.964174 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.964250 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.964326 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.964404 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.964475 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.964566 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.965017 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.965092 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.965373 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.965480 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.965574 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.965645 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.965714 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.965783 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.965939 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966108 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966194 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966266 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966342 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966414 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966554 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966630 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966700 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966777 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966848 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.966924 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967005 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967005 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967132 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967213 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967365 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967589 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967692 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967778 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967850 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967920 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.967989 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968064 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968134 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968215 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968291 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968367 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968437 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968507 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968582 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968661 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968738 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968813 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968882 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.968957 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969034 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969111 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969236 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969321 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969392 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969477 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969567 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969657 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969740 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969822 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969893 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.969968 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970050 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970121 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970190 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970259 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970327 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970406 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970484 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970602 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970705 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970784 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970855 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.970932 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971009 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971086 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971166 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971241 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971311 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971393 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971463 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971541 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971618 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971688 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971763 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971841 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971918 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.971988 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972155 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972237 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972334 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972411 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972499 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972595 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972674 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972756 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972756 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972897 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.972968 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.973043 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.973113 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.973217 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.973689 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.973774 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.973845 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.973914 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.973992 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.974071 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.974151 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.974222 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.974296 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.974366 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.974435 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.974516 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.974586 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.974662 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.974759 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.975030 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.975124 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.975204 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.975286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.975286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.976012 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.976012 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.976462 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.976546 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.976617 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.976617 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.976741 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.976859 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.976982 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977065 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977136 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977240 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977380 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977467 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977538 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977614 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977710 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977788 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977872 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.977949 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.978026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.978101 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.978177 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.978247 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.978331 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.978550 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.978644 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.978722 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.978801 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.978876 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.978953 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979046 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979121 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979190 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979273 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979344 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979451 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979527 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979596 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979666 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979741 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979817 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979887 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.979955 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980022 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980091 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980327 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980397 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980465 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980539 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980610 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980694 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980765 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980833 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980833 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980833 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980833 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.980833 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.981230 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.981305 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.981374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.981449 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.981449 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.981595 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.981666 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.981741 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.981823 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.981899 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.981979 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982049 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982117 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982185 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982253 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982328 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982405 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982480 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982563 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982633 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982726 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982886 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.982956 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.983031 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.983101 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.983173 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.983249 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.983326 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.983434 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.983519 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984148 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984222 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984303 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984374 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984443 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984518 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984588 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984669 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984740 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984808 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984883 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.984974 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.985239 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.985338 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.985418 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.985488 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.985565 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.985642 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.985642 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.985789 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.985861 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.985929 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.985997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986073 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986150 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986220 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986288 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986356 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986448 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986523 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986601 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986671 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986747 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986830 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986900 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.986968 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.987044 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.987121 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.987190 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.987190 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.987315 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.987315 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.987612 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.987736 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.987822 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.987904 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.987981 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988129 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988198 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988266 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988266 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988401 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988487 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988658 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988738 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988815 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988885 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.988966 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.989038 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.989117 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.989338 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.989419 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.989502 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.989603 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.989694 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.989778 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.989859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.989949 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.990040 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.990130 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.990213 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.990294 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.990382 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.990472 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.990567 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.990651 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.990732 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.990813 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.990901 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.991579 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.991685 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.991770 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.991851 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.991939 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992021 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992114 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992114 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992273 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992354 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992652 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992652 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992810 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992891 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.992973 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.993053 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.993142 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.993242 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.993352 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.993447 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.993529 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.993615 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.994508 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.994664 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.994763 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.994854 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.994946 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.995037 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.995121 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.995367 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.995471 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.995563 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.995699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.995699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996050 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996144 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996228 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996309 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996309 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996309 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996540 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996623 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996623 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996802 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996891 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.996891 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.997089 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.997898 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.997898 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.998100 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.998194 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.998194 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.998194 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.998430 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.998530 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.998615 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.998707 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.998791 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.998873 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.998873 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999019 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999108 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999108 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999283 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999367 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999455 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999545 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999640 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999724 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999724 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999875 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999956 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:26.999956 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.000542 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.000646 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.000745 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.000831 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.000913 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001004 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001004 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001004 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001004 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001004 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001004 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001497 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001595 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001679 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001760 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001760 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001760 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.001760 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.002072 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.002161 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.002251 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.002577 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.002705 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.002894 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.003209 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.003306 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.003527 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.004050 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.004168 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.004168 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.004333 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.004451 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.004770 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.004915 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.005086 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.005451 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.005559 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.005757 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.006057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.006150 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.006415 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.006678 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.006780 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.007083 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.007274 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.007405 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.007730 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.007821 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.008051 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.008363 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.008456 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.008678 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.008941 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.009034 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.009442 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.009613 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.009701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.009977 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.010069 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.010290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.010655 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.010761 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.011029 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.011196 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.011353 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.011688 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.011784 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.012009 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.012280 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.012385 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.012652 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.012891 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.012981 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.013311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.013538 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.013632 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.014037 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.014358 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.014595 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.014689 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.014953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.015193 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.015294 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.015593 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.015785 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.015906 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.016219 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.016392 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.016537 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.016873 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.016972 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.017234 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.017502 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.017609 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.017872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.018697 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.018819 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.018916 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.019000 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.019083 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.019161 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.019161 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.019439 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.019628 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.019763 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.020079 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.020181 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.020421 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.020685 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.020800 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.021049 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.021292 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.021398 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.021697 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.021871 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.022008 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.022348 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.022440 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.022687 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.022969 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.023069 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.023324 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.023549 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.023646 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.023966 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.024205 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.024465 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.024600 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.024693 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.024918 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.025232 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.025341 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.025675 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.025782 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.025902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.026220 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.026362 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.026988 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.027098 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.027184 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.027362 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.027551 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.027677 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.028013 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.028157 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.028350 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.028693 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.028802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.029033 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.029293 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.029402 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.029716 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.029906 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.030051 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.030373 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.030473 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.030691 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.030988 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.031091 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.031239 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 17:27:27.031580 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.032020 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.032449 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.032877 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.033334 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.033762 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.034332 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.034635 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.035025 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.035455 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.035886 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.036561 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.037007 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.037516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.038441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.038864 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.039292 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.039718 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.040152 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.040562 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.040951 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.041359 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.041768 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.042198 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.042565 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.042924 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.043255 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.043581 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.043904 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.044226 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.044600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.044924 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.045269 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.045591 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.045920 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.046244 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.046562 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.046882 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.047266 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.047518 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.047840 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.048157 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.048477 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.048800 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.049137 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.049500 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.050292 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.050506 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.050852 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.051163 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.051724 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.052051 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.052398 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.052737 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.053071 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.053486 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.054340 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.054682 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.055000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.055319 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.055641 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.055751 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_db.sqlalchemy.engines [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:27:27.055966 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.056281 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.056611 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.056930 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.057270 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.057599 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.057916 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.058466 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.058823 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.059150 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.059485 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.059817 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.060144 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.060459 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.060792 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.061106 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.061447 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.061774 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.062092 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.062404 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.062713 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.063031 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.063346 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.063655 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.063970 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.064282 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.064617 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.064931 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.065267 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.065585 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.065899 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.066213 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.069203 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.069203 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.069203 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.069203 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.069203 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.069203 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.069203 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.069203 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.069830 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.069830 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.069830 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.070035 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.070390 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.070711 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.071038 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.071356 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.071690 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.072006 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.072324 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.072879 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.072994 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.073579 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.074000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.074248 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.074591 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.074930 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.075244 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.075561 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.075869 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.076196 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.076524 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.076831 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.077239 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.077491 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.077809 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.078126 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.078441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.078758 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.079077 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.079410 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.079703 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.080026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.080514 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.080700 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.081023 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.081370 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.081695 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.082013 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.082341 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.082662 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.082948 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.083262 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.083695 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.084034 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.084347 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.084813 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.085289 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.085588 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.085900 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.086317 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.086548 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.086906 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.087197 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.087527 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.087844 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.088183 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.088548 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.088904 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.089278 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.089605 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.089913 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.090231 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.090549 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.090885 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.091223 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.091597 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.092080 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.092186 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.092492 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.092807 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.093137 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.093486 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.093812 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.094145 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.094469 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.094788 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.095109 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.095427 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.095749 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.096067 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.096383 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.096719 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.097054 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.097394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.097725 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.098050 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.098377 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.098698 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.099015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.099351 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.099670 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.099994 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.100860 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.101175 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.101512 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.101837 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.102171 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.102506 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.102840 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.103176 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.103527 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.103848 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.104199 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.104534 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.104854 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.105192 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.105519 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 17:27:27.105770 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 17:27:27.128020 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.context [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15ce609a-5a92-491c-9260-447d239d1ed2(cell1) {{(pid=116480) load_cells /opt/stack/nova/nova/context.py:464}} Feb 08 17:27:27.128831 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_db.sqlalchemy.engines [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:27:27.132167 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:27:27.133749 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:27:27.134561 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:27:27.136488 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:27:27.148032 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_db.sqlalchemy.engines [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:27:27.148812 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_db.sqlalchemy.engines [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:27:27.194209 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.context [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15ce609a-5a92-491c-9260-447d239d1ed2(cell1) {{(pid=116479) load_cells /opt/stack/nova/nova/context.py:464}} Feb 08 17:27:27.198447 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:27:27.200016 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:27:27.200828 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:27:27.202781 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:27:27.213696 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_db.sqlalchemy.engines [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:27:27.215042 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_db.sqlalchemy.engines [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:27:27.311140 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_db.sqlalchemy.engines [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:27:27.373078 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_db.sqlalchemy.engines [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 17:27:27.640898 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: WARNING keystonemiddleware.auth_token [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 17:27:27.648612 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: WARNING keystonemiddleware.auth_token [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 17:27:27.692928 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: WARNING keystonemiddleware.auth_token [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 17:27:27.700382 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: WARNING keystonemiddleware.auth_token [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 17:27:28.007547 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: WARNING keystonemiddleware.auth_token [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 17:27:28.013731 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: WARNING keystonemiddleware.auth_token [None req-f1a36751-a9b1-436c-a844-8c489a6e9cd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 17:27:28.019845 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cbe884a9c0 pid: 116480 (default app) Feb 08 17:27:28.045026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: WARNING keystonemiddleware.auth_token [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 17:27:28.050518 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: WARNING keystonemiddleware.auth_token [None req-a3d62500-9fc4-4760-a3c0-6d6ef5aec099 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 17:27:28.056249 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cbe884a9c0 pid: 116479 (default app) Feb 08 17:28:07.063502 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-917892692", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "networks": [{"uuid": "45349e8b-a612-4426-83e9-d10d4f48731d"}]}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:07.222758 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bf25035e-39ee-4bf7-8179-2f4f13086adf tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] Calling method '.version_select at 0x7fd9fc12ff70>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:07.644210 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.network.neutron [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] validate_networks() for [('45349e8b-a612-4426-83e9-d10d4f48731d', None, None, None, None, None)] {{(pid=116480) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:28:07.822673 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bf25035e-39ee-4bf7-8179-2f4f13086adf tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/fb005653-650a-4687-be45-56780ba3d3e4" status: 200 len: 350 microversion: 2.1 time: 1.060630 Feb 08 17:28:07.823262 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 1/1] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:28:06 2022] GET /compute/v2.1/os-volumes/fb005653-650a-4687-be45-56780ba3d3e4 => generated 350 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:28:09.461529 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7f3efd18-e2cb-4e27-b23e-1bbe4beca9b8 tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] Calling method '.version_select at 0x7fd9fbf78e50>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:09.573663 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7f3efd18-e2cb-4e27-b23e-1bbe4beca9b8 tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3825661f-2535-4dc0-954b-a101e7a182cd" status: 200 len: 350 microversion: 2.1 time: 0.121258 Feb 08 17:28:09.574603 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 2/2] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:28:09 2022] GET /compute/v2.1/os-volumes/3825661f-2535-4dc0-954b-a101e7a182cd => generated 350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:28:09.744254 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Flavor limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:28:09.746425 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Image limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:28:09.746937 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Flavor pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:28:09.747925 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Image pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:28:09.748528 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:28:09.785947 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:09.788970 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:09.792601 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:09.794576 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:09.888601 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Getting quotas for project e0fd043b62c54551965455405fd189e6. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:28:09.906706 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Getting quotas for user ed158308978e420ab1367f83fda6ee92 and project e0fd043b62c54551965455405fd189e6. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:28:09.967593 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Going to run 1 instances... {{(pid=116480) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:28:09.979426 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116480) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:28:10.244841 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8a66c47b-da75-47bd-be16-cd4b46ff0dee tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.882016 Feb 08 17:28:10.249684 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 1/3] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:28:10.263726 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-03d32d97-6b7d-4e5f-900e-f07a49a91779 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:10.274576 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-03d32d97-6b7d-4e5f-900e-f07a49a91779 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:10.848604 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-03d32d97-6b7d-4e5f-900e-f07a49a91779 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:10.902712 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-03d32d97-6b7d-4e5f-900e-f07a49a91779 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1214 microversion: 2.1 time: 0.645251 Feb 08 17:28:10.908085 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 3/4] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:10 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1214 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:11.925674 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9d821da1-e2e7-4aa9-a62f-319bc5b19b9f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:11.927261 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9d821da1-e2e7-4aa9-a62f-319bc5b19b9f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:12.442663 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9d821da1-e2e7-4aa9-a62f-319bc5b19b9f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:12.466703 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9d821da1-e2e7-4aa9-a62f-319bc5b19b9f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1214 microversion: 2.1 time: 0.545717 Feb 08 17:28:12.471783 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 2/5] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:11 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1214 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:13.491263 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-37e079f4-cfa7-4a3e-b683-632c83ec32d9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:13.492724 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-37e079f4-cfa7-4a3e-b683-632c83ec32d9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:13.501926 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37e079f4-cfa7-4a3e-b683-632c83ec32d9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:13.502782 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37e079f4-cfa7-4a3e-b683-632c83ec32d9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:13.504089 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37e079f4-cfa7-4a3e-b683-632c83ec32d9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:13.504789 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37e079f4-cfa7-4a3e-b683-632c83ec32d9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:14.167053 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-37e079f4-cfa7-4a3e-b683-632c83ec32d9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:14.188828 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-37e079f4-cfa7-4a3e-b683-632c83ec32d9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1218 microversion: 2.1 time: 0.702279 Feb 08 17:28:14.189446 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 4/6] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:13 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1218 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:15.046017 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a4145b69-6185-4c88-992e-80cd2850745d tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] Calling method '.version_select at 0x7fd9fae0f4c0>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:15.231743 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1d70cc81-33ca-43db-a458-ad8fdbe8f8a0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:15.233040 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1d70cc81-33ca-43db-a458-ad8fdbe8f8a0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:15.245379 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1d70cc81-33ca-43db-a458-ad8fdbe8f8a0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:15.250532 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1d70cc81-33ca-43db-a458-ad8fdbe8f8a0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:15.254762 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1d70cc81-33ca-43db-a458-ad8fdbe8f8a0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:15.258272 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1d70cc81-33ca-43db-a458-ad8fdbe8f8a0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:15.305375 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a4145b69-6185-4c88-992e-80cd2850745d tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/d5667904-24a7-4f8a-a35e-7d59de296e03" status: 200 len: 350 microversion: 2.1 time: 0.275714 Feb 08 17:28:15.306079 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 3/7] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:28:15 2022] GET /compute/v2.1/os-volumes/d5667904-24a7-4f8a-a35e-7d59de296e03 => generated 350 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:28:15.319849 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-602a566e-798d-4ff1-9578-4c1b1a5f059f tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] Calling method '.version_select at 0x7fd9fae23940>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:15.737946 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-602a566e-798d-4ff1-9578-4c1b1a5f059f tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.422339 Feb 08 17:28:15.738839 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 4/8] 10.222.0.69 () {58 vars in 1133 bytes} [Tue Feb 8 17:28:15 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:15.752435 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4c1eb289-402e-4c8d-8c04-c71459f907ab tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] Calling method '.version_select at 0x7fd9fadfcdc0>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:15.764344 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1d70cc81-33ca-43db-a458-ad8fdbe8f8a0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:15.777689 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1d70cc81-33ca-43db-a458-ad8fdbe8f8a0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1266 microversion: 2.1 time: 0.551496 Feb 08 17:28:15.778682 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 5/9] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:15 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1266 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:15.978901 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4c1eb289-402e-4c8d-8c04-c71459f907ab tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.230881 Feb 08 17:28:15.988656 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 5/10] 10.222.0.69 () {58 vars in 1148 bytes} [Tue Feb 8 17:28:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:28:15.999098 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a285ddbc-bd62-440c-9dc3-e7f4e6448eda tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] Calling method '.version_select at 0x7fd9fbe47c10>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:16.325942 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a285ddbc-bd62-440c-9dc3-e7f4e6448eda tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.332480 Feb 08 17:28:16.338082 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 6/11] 10.222.0.69 () {58 vars in 1133 bytes} [Tue Feb 8 17:28:15 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:16.353802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c93c91fa-8b18-471f-9367-70748c52ae64 tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] Calling method '.version_select at 0x7fd9fae06940>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:16.696583 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c93c91fa-8b18-471f-9367-70748c52ae64 tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.361465 Feb 08 17:28:16.698962 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 6/12] 10.222.0.69 () {58 vars in 1166 bytes} [Tue Feb 8 17:28:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:28:16.711696 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-899df2b0-94c4-4319-8ea1-a6d52649dda5 tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] Calling method '.version_select at 0x7fd9fbdd1040>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:16.800478 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e0db97fc-ccac-4dfd-ab58-c41dc6b8f1cd tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:16.801113 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e0db97fc-ccac-4dfd-ab58-c41dc6b8f1cd tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:16.822216 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e0db97fc-ccac-4dfd-ab58-c41dc6b8f1cd tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:16.824850 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e0db97fc-ccac-4dfd-ab58-c41dc6b8f1cd tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:16.825840 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e0db97fc-ccac-4dfd-ab58-c41dc6b8f1cd tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:16.826294 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e0db97fc-ccac-4dfd-ab58-c41dc6b8f1cd tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:17.202483 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-899df2b0-94c4-4319-8ea1-a6d52649dda5 tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.495250 Feb 08 17:28:17.210796 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 7/13] 10.222.0.69 () {58 vars in 1169 bytes} [Tue Feb 8 17:28:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:28:17.215957 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e4b886bb-27c6-4beb-b33c-6b4209a84a3e tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] Calling method '.version_select at 0x7fd9fbe1f430>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:17.270862 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e0db97fc-ccac-4dfd-ab58-c41dc6b8f1cd tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:17.293700 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e0db97fc-ccac-4dfd-ab58-c41dc6b8f1cd tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1272 microversion: 2.1 time: 0.501184 Feb 08 17:28:17.295691 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 7/14] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:16 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1272 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:17.530669 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e4b886bb-27c6-4beb-b33c-6b4209a84a3e tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.319243 Feb 08 17:28:17.531975 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 8/15] 10.222.0.69 () {58 vars in 1154 bytes} [Tue Feb 8 17:28:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:17.553021 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2c46d235-c144-4a09-ae2a-49ce4faf84e6 tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] Calling method '.version_select at 0x7fd9fad1e5e0>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:17.752819 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2c46d235-c144-4a09-ae2a-49ce4faf84e6 tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.204701 Feb 08 17:28:17.753562 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 8/16] 10.222.0.69 () {58 vars in 1187 bytes} [Tue Feb 8 17:28:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:28:17.771304 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-75e8ae83-2551-40fd-9121-c6387026e386 tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] Calling method '.version_select at 0x7fd9fad78430>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:18.204431 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-75e8ae83-2551-40fd-9121-c6387026e386 tempest-VolumesTestJSON-505206692 tempest-VolumesTestJSON-505206692-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.436151 Feb 08 17:28:18.206303 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 9/17] 10.222.0.69 () {58 vars in 1154 bytes} [Tue Feb 8 17:28:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:18.317819 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1832eb85-0a2f-411b-a458-9e2d50ee4e5f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:18.324656 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1832eb85-0a2f-411b-a458-9e2d50ee4e5f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:18.352079 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1832eb85-0a2f-411b-a458-9e2d50ee4e5f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:18.356959 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1832eb85-0a2f-411b-a458-9e2d50ee4e5f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:18.366138 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1832eb85-0a2f-411b-a458-9e2d50ee4e5f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:18.367498 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1832eb85-0a2f-411b-a458-9e2d50ee4e5f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:18.564708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1832eb85-0a2f-411b-a458-9e2d50ee4e5f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:18.577708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1832eb85-0a2f-411b-a458-9e2d50ee4e5f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1272 microversion: 2.1 time: 0.267772 Feb 08 17:28:18.579003 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 10/18] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:18 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:18.587233 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-384130715", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:18.937987 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.network.neutron [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] validate_networks() for [('e46790e1-2cb6-4cb5-8030-eb0d54e8c51c', None, None, None, None, None)] {{(pid=116479) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:28:19.618966 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c1bb1b8c-dd2f-4eab-86e2-714d290f23bb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:19.628407 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c1bb1b8c-dd2f-4eab-86e2-714d290f23bb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:19.665141 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c1bb1b8c-dd2f-4eab-86e2-714d290f23bb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:19.667203 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c1bb1b8c-dd2f-4eab-86e2-714d290f23bb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:19.673538 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c1bb1b8c-dd2f-4eab-86e2-714d290f23bb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:19.684197 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c1bb1b8c-dd2f-4eab-86e2-714d290f23bb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:20.299408 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c1bb1b8c-dd2f-4eab-86e2-714d290f23bb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:20.313463 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c1bb1b8c-dd2f-4eab-86e2-714d290f23bb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1272 microversion: 2.1 time: 0.718224 Feb 08 17:28:20.316858 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 11/19] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:19 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1272 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:21.348119 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-134d062e-14dd-4563-aa8d-83f1566a277f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:21.351240 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-134d062e-14dd-4563-aa8d-83f1566a277f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:21.393487 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-134d062e-14dd-4563-aa8d-83f1566a277f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:21.394285 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-134d062e-14dd-4563-aa8d-83f1566a277f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:21.404156 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-134d062e-14dd-4563-aa8d-83f1566a277f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:21.413271 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-134d062e-14dd-4563-aa8d-83f1566a277f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:21.979544 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-134d062e-14dd-4563-aa8d-83f1566a277f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:22.023595 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-134d062e-14dd-4563-aa8d-83f1566a277f tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1272 microversion: 2.1 time: 0.677924 Feb 08 17:28:22.025337 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 12/20] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:21 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1272 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:23.055558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7b9ef62b-2318-480f-95ed-8489899ef0a9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:23.056805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7b9ef62b-2318-480f-95ed-8489899ef0a9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:23.092755 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b9ef62b-2318-480f-95ed-8489899ef0a9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:23.097114 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b9ef62b-2318-480f-95ed-8489899ef0a9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:23.101995 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b9ef62b-2318-480f-95ed-8489899ef0a9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:23.102936 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b9ef62b-2318-480f-95ed-8489899ef0a9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:24.105061 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Flavor limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:28:24.105701 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Image limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:28:24.106015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Flavor pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:28:24.106634 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Image pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:28:24.107072 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:28:24.142416 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:24.143829 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:24.146676 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:24.159495 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:24.295931 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Getting quotas for project 80022e131af94dfb9d6069b7d0492189. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:28:24.318947 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Getting quotas for user e17e28d06d6b4f72b850d5cc0f983f6d and project 80022e131af94dfb9d6069b7d0492189. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:28:24.362437 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Going to run 1 instances... {{(pid=116479) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:28:24.378670 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:28:24.760627 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0cd934a5-18d2-41f5-bc79-20351bbc450d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.146033 Feb 08 17:28:24.769319 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 9/21] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:28:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 7156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 08 17:28:25.278551 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7b9ef62b-2318-480f-95ed-8489899ef0a9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:25.297945 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7b9ef62b-2318-480f-95ed-8489899ef0a9 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 2.237879 Feb 08 17:28:25.300140 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 13/22] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:23 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 2250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:25.312039 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6650e70e-d8b8-4d58-9272-8285e20a5b95 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:25.315284 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6650e70e-d8b8-4d58-9272-8285e20a5b95 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:25.598911 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3c3cd39b-d5b5-4087-87af-4f3a34f0ea03 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Action: 'create', calling method: .version_select at 0x7fd9fb52d550>, body: {"keypair": {"name": "tempest-keypair-1847212022"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:25.673437 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-3c3cd39b-d5b5-4087-87af-4f3a34f0ea03 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:28:25.686865 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-3c3cd39b-d5b5-4087-87af-4f3a34f0ea03 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for user 431b80f782ae4fd7962ca5e91fa7477f and project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:28:25.721923 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6650e70e-d8b8-4d58-9272-8285e20a5b95 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:25.742407 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6650e70e-d8b8-4d58-9272-8285e20a5b95 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1221 microversion: 2.1 time: 0.434670 Feb 08 17:28:25.746516 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 14/23] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:25 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1221 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:26.073759 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1373582902", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:26.333593 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.network.neutron [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] validate_networks() for [('e46790e1-2cb6-4cb5-8030-eb0d54e8c51c', None, None, None, None, None)] {{(pid=116480) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:28:26.548618 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-3c3cd39b-d5b5-4087-87af-4f3a34f0ea03 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:28:26.571845 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-3c3cd39b-d5b5-4087-87af-4f3a34f0ea03 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for user 431b80f782ae4fd7962ca5e91fa7477f and project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:28:26.607346 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3c3cd39b-d5b5-4087-87af-4f3a34f0ea03 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.836071 Feb 08 17:28:26.611519 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 10/24] 10.222.0.69 () {62 vars in 1198 bytes} [Tue Feb 8 17:28:24 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1841 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 08 17:28:26.622430 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e1fc1cfa-fe16-4642-99a0-5b364a8733a6 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:26.623286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-e1fc1cfa-fe16-4642-99a0-5b364a8733a6 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:26.657994 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1fc1cfa-fe16-4642-99a0-5b364a8733a6 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:26.662852 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1fc1cfa-fe16-4642-99a0-5b364a8733a6 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:26.671667 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1fc1cfa-fe16-4642-99a0-5b364a8733a6 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:26.672216 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1fc1cfa-fe16-4642-99a0-5b364a8733a6 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:29.463624 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e1fc1cfa-fe16-4642-99a0-5b364a8733a6 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:29.471807 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e1fc1cfa-fe16-4642-99a0-5b364a8733a6 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 2.859136 Feb 08 17:28:29.478245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 11/25] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:26 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 2866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:29.663943 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-dd4ada8c-8bce-4785-a9a8-3eb5e3c0374a req-dc19758f-5082-4de9-ba07-06b4230396a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c13b043-55ff-4372-99f9-1e4453cf6d65", "tag": "8d8d9a21-bb56-4e6b-b9fb-bdcf1e8ca8c2"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:29.667183 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:28:29.667183 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:28:29.698189 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-dd4ada8c-8bce-4785-a9a8-3eb5e3c0374a req-dc19758f-5082-4de9-ba07-06b4230396a5 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:29.700405 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-dd4ada8c-8bce-4785-a9a8-3eb5e3c0374a req-dc19758f-5082-4de9-ba07-06b4230396a5 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:29.789653 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-dd4ada8c-8bce-4785-a9a8-3eb5e3c0374a req-dc19758f-5082-4de9-ba07-06b4230396a5 service nova] Creating event network-changed:8d8d9a21-bb56-4e6b-b9fb-bdcf1e8ca8c2 for instance 2c13b043-55ff-4372-99f9-1e4453cf6d65 on hv-cinder-82204 Feb 08 17:28:29.790684 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-dd4ada8c-8bce-4785-a9a8-3eb5e3c0374a req-dc19758f-5082-4de9-ba07-06b4230396a5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 08 17:28:29.792126 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-55a0e135-8667-4e4a-b537-be6577de615f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:29.792911 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-55a0e135-8667-4e4a-b537-be6577de615f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:29.793895 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-55a0e135-8667-4e4a-b537-be6577de615f None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:29.794652 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-55a0e135-8667-4e4a-b537-be6577de615f None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:29.831530 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.compute.rpcapi [None req-55a0e135-8667-4e4a-b537-be6577de615f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 08 17:28:29.832704 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-55a0e135-8667-4e4a-b537-be6577de615f None None] Releasing lock "compute-rpcapi-router" {{(pid=116479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 08 17:28:29.883283 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-55a0e135-8667-4e4a-b537-be6577de615f None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.403251 Feb 08 17:28:29.884350 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 12/26] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:28:30.503867 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6c447c36-4b73-4afb-b6c6-1897e8ec0b4d tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:30.504743 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6c447c36-4b73-4afb-b6c6-1897e8ec0b4d tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:30.517057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6c447c36-4b73-4afb-b6c6-1897e8ec0b4d tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:30.529834 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6c447c36-4b73-4afb-b6c6-1897e8ec0b4d tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:30.533567 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6c447c36-4b73-4afb-b6c6-1897e8ec0b4d tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:30.539588 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6c447c36-4b73-4afb-b6c6-1897e8ec0b4d tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:31.226774 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Flavor limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:28:31.227617 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Image limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:28:31.229619 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Flavor pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:28:31.230553 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Image pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:28:31.231446 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:28:31.271765 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:31.273420 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:31.276148 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:31.277822 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:31.358237 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Getting quotas for project 80022e131af94dfb9d6069b7d0492189. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:28:31.377502 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Getting quotas for user e17e28d06d6b4f72b850d5cc0f983f6d and project 80022e131af94dfb9d6069b7d0492189. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:28:31.450380 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Going to run 1 instances... {{(pid=116480) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:28:31.456779 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116480) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:28:31.618177 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-721f2dd7-db50-42ba-972c-c4a46e72c3e6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.550699 Feb 08 17:28:31.622942 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 15/27] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:28:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 5556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 08 17:28:31.649365 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3ae3e20d-c887-40c7-adbe-d164ecc95a10 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:31.652801 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3ae3e20d-c887-40c7-adbe-d164ecc95a10 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:31.917205 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3ae3e20d-c887-40c7-adbe-d164ecc95a10 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:31.924063 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3ae3e20d-c887-40c7-adbe-d164ecc95a10 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1222 microversion: 2.1 time: 0.296291 Feb 08 17:28:31.933258 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 16/28] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:31 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1222 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:32.393757 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6c447c36-4b73-4afb-b6c6-1897e8ec0b4d tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:32.409500 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6c447c36-4b73-4afb-b6c6-1897e8ec0b4d tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 1.909637 Feb 08 17:28:32.410353 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 13/29] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:30 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:32.946493 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-466d55d3-1b89-4b8f-84b1-12033478661c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:32.948398 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-466d55d3-1b89-4b8f-84b1-12033478661c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:32.957223 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-466d55d3-1b89-4b8f-84b1-12033478661c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:32.958014 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-466d55d3-1b89-4b8f-84b1-12033478661c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:32.960639 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-466d55d3-1b89-4b8f-84b1-12033478661c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:32.961533 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-466d55d3-1b89-4b8f-84b1-12033478661c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:33.239936 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-466d55d3-1b89-4b8f-84b1-12033478661c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:33.263789 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-466d55d3-1b89-4b8f-84b1-12033478661c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1226 microversion: 2.1 time: 0.321924 Feb 08 17:28:33.265918 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 17/30] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:32 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1226 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:33.436401 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ee4f9acc-ac47-4eac-8d5b-c9f927aad4b3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:33.449953 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ee4f9acc-ac47-4eac-8d5b-c9f927aad4b3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:33.503452 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ee4f9acc-ac47-4eac-8d5b-c9f927aad4b3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:33.506684 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ee4f9acc-ac47-4eac-8d5b-c9f927aad4b3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:33.528685 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ee4f9acc-ac47-4eac-8d5b-c9f927aad4b3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:33.539395 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ee4f9acc-ac47-4eac-8d5b-c9f927aad4b3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:34.287073 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4d28d293-ce7d-40d7-9114-493e7d4fe857 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:34.288301 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4d28d293-ce7d-40d7-9114-493e7d4fe857 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:34.303931 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4d28d293-ce7d-40d7-9114-493e7d4fe857 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:34.305026 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4d28d293-ce7d-40d7-9114-493e7d4fe857 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:34.306030 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4d28d293-ce7d-40d7-9114-493e7d4fe857 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:34.307313 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4d28d293-ce7d-40d7-9114-493e7d4fe857 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:34.781266 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4d28d293-ce7d-40d7-9114-493e7d4fe857 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:34.809465 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4d28d293-ce7d-40d7-9114-493e7d4fe857 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1282 microversion: 2.1 time: 0.530287 Feb 08 17:28:34.838211 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 18/31] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:34 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1282 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:35.733175 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ee4f9acc-ac47-4eac-8d5b-c9f927aad4b3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:35.749238 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ee4f9acc-ac47-4eac-8d5b-c9f927aad4b3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 2.321567 Feb 08 17:28:35.753673 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 14/32] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:33 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 2329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:35.760114 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-eb8ae253-14b5-49dc-af81-f847e22093fd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Action: 'create', calling method: .version_select at 0x7fd9fadfcee0>, body: {"keypair": {"name": "tempest-keypair-2038215287"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:35.809623 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-eb8ae253-14b5-49dc-af81-f847e22093fd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'key_pairs'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:28:35.818937 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-eb8ae253-14b5-49dc-af81-f847e22093fd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for user 9d0970b8e8ce4ef5853e58cfdd797ec8 and project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'key_pairs'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:28:35.844185 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5b3ead9f-c381-429c-a194-df0805d96e16 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:35.845622 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5b3ead9f-c381-429c-a194-df0805d96e16 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:35.878536 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5b3ead9f-c381-429c-a194-df0805d96e16 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:35.882197 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5b3ead9f-c381-429c-a194-df0805d96e16 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:35.883318 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5b3ead9f-c381-429c-a194-df0805d96e16 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:35.883917 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5b3ead9f-c381-429c-a194-df0805d96e16 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:36.104585 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-eb8ae253-14b5-49dc-af81-f847e22093fd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'key_pairs'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:28:36.113343 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-eb8ae253-14b5-49dc-af81-f847e22093fd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for user 9d0970b8e8ce4ef5853e58cfdd797ec8 and project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'key_pairs'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:28:36.138026 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-eb8ae253-14b5-49dc-af81-f847e22093fd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.284890 Feb 08 17:28:36.140372 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 19/33] 10.222.0.69 () {60 vars in 1157 bytes} [Tue Feb 8 17:28:34 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:36.190069 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5b3ead9f-c381-429c-a194-df0805d96e16 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:36.205598 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5b3ead9f-c381-429c-a194-df0805d96e16 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1280 microversion: 2.1 time: 0.365770 Feb 08 17:28:36.206765 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 15/34] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:35 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1280 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:36.772753 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7fec3e88-adc1-4aa9-8ed6-e506fcc63279 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:36.774981 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7fec3e88-adc1-4aa9-8ed6-e506fcc63279 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:36.802681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7fec3e88-adc1-4aa9-8ed6-e506fcc63279 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:36.803697 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7fec3e88-adc1-4aa9-8ed6-e506fcc63279 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:36.808132 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7fec3e88-adc1-4aa9-8ed6-e506fcc63279 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:36.808991 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7fec3e88-adc1-4aa9-8ed6-e506fcc63279 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:37.224553 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c4afb0b3-8d6a-405d-b5f0-eade059ba531 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:37.226013 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c4afb0b3-8d6a-405d-b5f0-eade059ba531 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:37.249616 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c4afb0b3-8d6a-405d-b5f0-eade059ba531 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:37.252951 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c4afb0b3-8d6a-405d-b5f0-eade059ba531 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:37.255076 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c4afb0b3-8d6a-405d-b5f0-eade059ba531 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:37.258847 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c4afb0b3-8d6a-405d-b5f0-eade059ba531 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:37.680667 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7fec3e88-adc1-4aa9-8ed6-e506fcc63279 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:37.699810 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7fec3e88-adc1-4aa9-8ed6-e506fcc63279 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.923738 Feb 08 17:28:37.702821 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 20/35] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:36 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:37.810647 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-c4afb0b3-8d6a-405d-b5f0-eade059ba531 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:37.823243 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c4afb0b3-8d6a-405d-b5f0-eade059ba531 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1280 microversion: 2.1 time: 0.602655 Feb 08 17:28:37.823855 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 16/36] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:37 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1280 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:38.216159 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1915500270", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccd61454-4568-47e1-b525-83b47e7e5945"}], "security_groups": [{"name": "tempest-securitygroup--307475028"}], "key_name": "tempest-keypair-1847212022", "user_data": "}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:38.352055 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-4ff8be55-d40e-4c7a-a19d-d101aea1d531 req-3dfabcda-90be-4170-b1ac-83818e852273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3008c9c2-fd0b-4740-9eac-4b0cecaaf870", "tag": "31b3853a-c848-4c47-9011-d681d4245eae"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:38.354811 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:28:38.354811 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:28:38.385949 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-4ff8be55-d40e-4c7a-a19d-d101aea1d531 req-3dfabcda-90be-4170-b1ac-83818e852273 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:38.387183 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-4ff8be55-d40e-4c7a-a19d-d101aea1d531 req-3dfabcda-90be-4170-b1ac-83818e852273 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:38.404158 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-4ff8be55-d40e-4c7a-a19d-d101aea1d531 req-3dfabcda-90be-4170-b1ac-83818e852273 service nova] Creating event network-changed:31b3853a-c848-4c47-9011-d681d4245eae for instance 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 on hv-cinder-82204 Feb 08 17:28:38.413557 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-4ff8be55-d40e-4c7a-a19d-d101aea1d531 req-3dfabcda-90be-4170-b1ac-83818e852273 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065880 Feb 08 17:28:38.415406 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 17/37] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:28:38.717567 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.network.neutron [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] validate_networks() for [('ccd61454-4568-47e1-b525-83b47e7e5945', None, None, None, None, None)] {{(pid=116480) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:28:38.728177 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-dc8b0105-46a1-46d7-8ccc-674cc6ec5a94 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:38.731572 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-dc8b0105-46a1-46d7-8ccc-674cc6ec5a94 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:38.745376 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc8b0105-46a1-46d7-8ccc-674cc6ec5a94 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:38.746902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc8b0105-46a1-46d7-8ccc-674cc6ec5a94 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:38.748056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc8b0105-46a1-46d7-8ccc-674cc6ec5a94 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:38.750875 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc8b0105-46a1-46d7-8ccc-674cc6ec5a94 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:39.498471 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-dc8b0105-46a1-46d7-8ccc-674cc6ec5a94 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:39.517757 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-dc8b0105-46a1-46d7-8ccc-674cc6ec5a94 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.801218 Feb 08 17:28:39.525606 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 18/38] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:38 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:39.549534 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-53255f77-d359-44fe-a08e-8282acf8eef4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:39.550196 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-53255f77-d359-44fe-a08e-8282acf8eef4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:39.586695 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-53255f77-d359-44fe-a08e-8282acf8eef4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:39.587171 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-53255f77-d359-44fe-a08e-8282acf8eef4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:39.590787 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-53255f77-d359-44fe-a08e-8282acf8eef4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:39.591261 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-53255f77-d359-44fe-a08e-8282acf8eef4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:40.292958 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-53255f77-d359-44fe-a08e-8282acf8eef4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:40.314225 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-53255f77-d359-44fe-a08e-8282acf8eef4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 0.790890 Feb 08 17:28:40.337498 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 19/39] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:39 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:40.517421 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Flavor limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:28:40.521462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Image limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:28:40.523457 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Flavor pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:28:40.524557 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Image pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:28:40.525621 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:28:40.547057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-24b61e39-01a0-48d6-b222-b645f07dcebb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:40.547947 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-24b61e39-01a0-48d6-b222-b645f07dcebb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:40.554580 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:40.557039 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:40.559018 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:40.560151 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:40.566966 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24b61e39-01a0-48d6-b222-b645f07dcebb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:40.569752 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24b61e39-01a0-48d6-b222-b645f07dcebb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:40.570613 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24b61e39-01a0-48d6-b222-b645f07dcebb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:40.571063 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24b61e39-01a0-48d6-b222-b645f07dcebb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:40.627065 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:28:40.706852 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for user 431b80f782ae4fd7962ca5e91fa7477f and project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:28:40.765431 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Going to run 1 instances... {{(pid=116480) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:28:40.772872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116480) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:28:40.917020 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-537aedb7-7ecc-4927-9563-188facc91eea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.706179 Feb 08 17:28:40.919368 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 21/40] 10.222.0.69 () {62 vars in 1187 bytes} [Tue Feb 8 17:28:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 2709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 08 17:28:40.933132 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5d0b90aa-ed5a-4d3a-bef9-3a20ac932d24 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:40.958782 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5d0b90aa-ed5a-4d3a-bef9-3a20ac932d24 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:41.433597 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-24b61e39-01a0-48d6-b222-b645f07dcebb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:41.447962 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5d0b90aa-ed5a-4d3a-bef9-3a20ac932d24 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:41.455230 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-24b61e39-01a0-48d6-b222-b645f07dcebb tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.915572 Feb 08 17:28:41.468590 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5d0b90aa-ed5a-4d3a-bef9-3a20ac932d24 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:41.472159 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5d0b90aa-ed5a-4d3a-bef9-3a20ac932d24 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:41.473472 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 20/41] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:40 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:41.477348 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5d0b90aa-ed5a-4d3a-bef9-3a20ac932d24 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1282 microversion: 2.20 time: 0.544323 Feb 08 17:28:41.479371 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 22/42] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:40 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1282 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:28:41.487521 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-15016f9a-d2f3-4cb8-80e6-78884edd4353 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:41.491101 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-15016f9a-d2f3-4cb8-80e6-78884edd4353 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:41.506586 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15016f9a-d2f3-4cb8-80e6-78884edd4353 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:41.507288 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15016f9a-d2f3-4cb8-80e6-78884edd4353 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:41.508267 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15016f9a-d2f3-4cb8-80e6-78884edd4353 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:41.508858 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15016f9a-d2f3-4cb8-80e6-78884edd4353 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:42.126150 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-15016f9a-d2f3-4cb8-80e6-78884edd4353 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:42.161436 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-15016f9a-d2f3-4cb8-80e6-78884edd4353 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 0.681182 Feb 08 17:28:42.168532 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 21/43] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:41 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:42.485631 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-556864df-4e95-4bfd-bc1a-db33a6bdc99a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:42.487330 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-556864df-4e95-4bfd-bc1a-db33a6bdc99a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:42.510020 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-556864df-4e95-4bfd-bc1a-db33a6bdc99a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:42.511207 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-556864df-4e95-4bfd-bc1a-db33a6bdc99a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:42.514015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-556864df-4e95-4bfd-bc1a-db33a6bdc99a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:42.515200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-556864df-4e95-4bfd-bc1a-db33a6bdc99a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:42.601823 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-82d45549-a786-447f-8bc9-5750972dd0a1 req-c1548f76-2d97-4721-9d20-c636345c1adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59fe4eef-a72f-4590-8612-3fd439dd28e9", "tag": "6abb2636-5f5b-42a8-9a24-6721d7a23d2b"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:42.612360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:28:42.612360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:28:42.647935 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-82d45549-a786-447f-8bc9-5750972dd0a1 req-c1548f76-2d97-4721-9d20-c636345c1adc service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:42.649293 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-82d45549-a786-447f-8bc9-5750972dd0a1 req-c1548f76-2d97-4721-9d20-c636345c1adc service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:42.751135 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-82d45549-a786-447f-8bc9-5750972dd0a1 req-c1548f76-2d97-4721-9d20-c636345c1adc service nova] Creating event network-changed:6abb2636-5f5b-42a8-9a24-6721d7a23d2b for instance 59fe4eef-a72f-4590-8612-3fd439dd28e9 on hv-cinder-82204 Feb 08 17:28:42.752112 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-82d45549-a786-447f-8bc9-5750972dd0a1 req-c1548f76-2d97-4721-9d20-c636345c1adc service nova] Acquired lock "compute-rpcapi-router" {{(pid=116480) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 08 17:28:42.754449 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5362c5f3-0428-49d5-89ff-60e836434f5a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:42.764424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5362c5f3-0428-49d5-89ff-60e836434f5a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:42.766211 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5362c5f3-0428-49d5-89ff-60e836434f5a None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:42.767012 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5362c5f3-0428-49d5-89ff-60e836434f5a None None] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:42.811481 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.compute.rpcapi [None req-5362c5f3-0428-49d5-89ff-60e836434f5a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 08 17:28:42.817659 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5362c5f3-0428-49d5-89ff-60e836434f5a None None] Releasing lock "compute-rpcapi-router" {{(pid=116480) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 08 17:28:42.863281 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5362c5f3-0428-49d5-89ff-60e836434f5a None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.420210 Feb 08 17:28:42.864939 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 23/44] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:28:42.876661 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-16cd491c-bc60-4081-891f-7771de35b60b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:42.879257 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-556864df-4e95-4bfd-bc1a-db33a6bdc99a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:42.880115 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-16cd491c-bc60-4081-891f-7771de35b60b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:42.893644 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-16cd491c-bc60-4081-891f-7771de35b60b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:42.894342 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-556864df-4e95-4bfd-bc1a-db33a6bdc99a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.416690 Feb 08 17:28:42.894950 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 22/45] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:42 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:42.895585 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-16cd491c-bc60-4081-891f-7771de35b60b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:42.898790 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-16cd491c-bc60-4081-891f-7771de35b60b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:42.899556 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-16cd491c-bc60-4081-891f-7771de35b60b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:43.074068 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-16cd491c-bc60-4081-891f-7771de35b60b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:43.088078 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-16cd491c-bc60-4081-891f-7771de35b60b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:43.092247 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-16cd491c-bc60-4081-891f-7771de35b60b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:43.093496 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-16cd491c-bc60-4081-891f-7771de35b60b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1334 microversion: 2.20 time: 0.225456 Feb 08 17:28:43.094279 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:42 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1334 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:28:43.185532 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6abf8c56-3f79-49a7-826e-5b6ebf1d2680 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:43.189093 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6abf8c56-3f79-49a7-826e-5b6ebf1d2680 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:43.199997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6abf8c56-3f79-49a7-826e-5b6ebf1d2680 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:43.219173 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6abf8c56-3f79-49a7-826e-5b6ebf1d2680 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:43.221300 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6abf8c56-3f79-49a7-826e-5b6ebf1d2680 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:43.223010 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6abf8c56-3f79-49a7-826e-5b6ebf1d2680 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:43.909112 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6abf8c56-3f79-49a7-826e-5b6ebf1d2680 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:43.923926 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6abf8c56-3f79-49a7-826e-5b6ebf1d2680 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 0.749346 Feb 08 17:28:43.924760 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 23/47] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:43 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:43.925353 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-227aee18-50ef-4fdf-bc8c-25fe56820fd8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:43.927557 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-227aee18-50ef-4fdf-bc8c-25fe56820fd8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:43.942016 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-227aee18-50ef-4fdf-bc8c-25fe56820fd8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:43.944568 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-227aee18-50ef-4fdf-bc8c-25fe56820fd8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:43.946420 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-227aee18-50ef-4fdf-bc8c-25fe56820fd8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:43.947016 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-227aee18-50ef-4fdf-bc8c-25fe56820fd8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:44.116423 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-407daca0-2bef-4df5-b795-91f618e0f647 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:44.116527 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-407daca0-2bef-4df5-b795-91f618e0f647 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:44.134091 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-407daca0-2bef-4df5-b795-91f618e0f647 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:44.134637 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-407daca0-2bef-4df5-b795-91f618e0f647 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:44.135625 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-407daca0-2bef-4df5-b795-91f618e0f647 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:44.136132 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-407daca0-2bef-4df5-b795-91f618e0f647 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:44.351630 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-407daca0-2bef-4df5-b795-91f618e0f647 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:44.372605 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-407daca0-2bef-4df5-b795-91f618e0f647 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:44.377299 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-407daca0-2bef-4df5-b795-91f618e0f647 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:44.380780 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-407daca0-2bef-4df5-b795-91f618e0f647 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1340 microversion: 2.20 time: 0.268237 Feb 08 17:28:44.382895 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 24/48] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:44 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1340 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:28:44.530902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-38fe332b-7db0-423a-890d-67c5b74bbf4e req-7b0b9880-3602-4a7f-8e57-bf27d2d6b211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3008c9c2-fd0b-4740-9eac-4b0cecaaf870", "name": "network-vif-plugged", "status": "completed", "tag": "31b3853a-c848-4c47-9011-d681d4245eae"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:44.533912 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:28:44.533912 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:28:44.545052 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-38fe332b-7db0-423a-890d-67c5b74bbf4e req-7b0b9880-3602-4a7f-8e57-bf27d2d6b211 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:44.545970 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-38fe332b-7db0-423a-890d-67c5b74bbf4e req-7b0b9880-3602-4a7f-8e57-bf27d2d6b211 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:44.564397 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-38fe332b-7db0-423a-890d-67c5b74bbf4e req-7b0b9880-3602-4a7f-8e57-bf27d2d6b211 service nova] Creating event network-vif-plugged:31b3853a-c848-4c47-9011-d681d4245eae for instance 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 on hv-cinder-82204 Feb 08 17:28:44.576660 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-38fe332b-7db0-423a-890d-67c5b74bbf4e req-7b0b9880-3602-4a7f-8e57-bf27d2d6b211 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190901 Feb 08 17:28:44.576660 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 25/49] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:28:44.786680 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-227aee18-50ef-4fdf-bc8c-25fe56820fd8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:44.798711 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-227aee18-50ef-4fdf-bc8c-25fe56820fd8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.879173 Feb 08 17:28:44.799934 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 25/50] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:43 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:44.968905 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c67eca7d-47c4-4409-9426-f3b664b087e0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:44.974082 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c67eca7d-47c4-4409-9426-f3b664b087e0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:45.007489 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c67eca7d-47c4-4409-9426-f3b664b087e0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:45.009568 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c67eca7d-47c4-4409-9426-f3b664b087e0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:45.011116 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c67eca7d-47c4-4409-9426-f3b664b087e0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:45.014264 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c67eca7d-47c4-4409-9426-f3b664b087e0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:45.064834 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-217501979", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f53cffab-2cd9-4d72-a0c8-7ee042426cd4"}], "security_groups": [{"name": "tempest-securitygroup--1491294516"}], "key_name": "tempest-keypair-2038215287", "user_data": "}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:45.765592 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.network.neutron [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] validate_networks() for [('f53cffab-2cd9-4d72-a0c8-7ee042426cd4', None, None, None, None, None)] {{(pid=116480) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:28:45.884516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-c67eca7d-47c4-4409-9426-f3b664b087e0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:45.901369 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c67eca7d-47c4-4409-9426-f3b664b087e0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 0.949158 Feb 08 17:28:45.903141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 26/51] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:44 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:45.957671 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6839640f-b00d-4120-842a-872236b9a6b0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:45.958748 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6839640f-b00d-4120-842a-872236b9a6b0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:45.980016 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6839640f-b00d-4120-842a-872236b9a6b0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:45.986935 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6839640f-b00d-4120-842a-872236b9a6b0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:45.989324 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6839640f-b00d-4120-842a-872236b9a6b0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:45.990341 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6839640f-b00d-4120-842a-872236b9a6b0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:46.188567 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6839640f-b00d-4120-842a-872236b9a6b0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:46.197961 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6839640f-b00d-4120-842a-872236b9a6b0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:46.199523 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6839640f-b00d-4120-842a-872236b9a6b0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:46.200677 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6839640f-b00d-4120-842a-872236b9a6b0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.262989 Feb 08 17:28:46.201284 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:45 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:28:46.210886 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-352d4f97-36e4-41fd-ae18-9f092202257c tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:46.212425 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-352d4f97-36e4-41fd-ae18-9f092202257c tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:46.219229 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-352d4f97-36e4-41fd-ae18-9f092202257c tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:46.219796 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-352d4f97-36e4-41fd-ae18-9f092202257c tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:46.220718 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-352d4f97-36e4-41fd-ae18-9f092202257c tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:46.221405 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-352d4f97-36e4-41fd-ae18-9f092202257c tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:46.426883 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Flavor limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:28:46.427386 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Image limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:28:46.427774 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Flavor pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:28:46.428207 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Image pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:28:46.428622 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:28:46.437823 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:46.438275 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:46.439108 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:46.439548 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:46.440709 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-352d4f97-36e4-41fd-ae18-9f092202257c tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:46.450243 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-352d4f97-36e4-41fd-ae18-9f092202257c tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.247528 Feb 08 17:28:46.450869 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 28/53] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:46 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:46.463178 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:28:46.470438 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for user 9d0970b8e8ce4ef5853e58cfdd797ec8 and project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:28:46.495123 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Going to run 1 instances... {{(pid=116480) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:28:46.497881 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116480) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:28:46.551668 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7b327bd5-36f2-472b-8b4e-eff599bb7ba0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.490364 Feb 08 17:28:46.552374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 26/54] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:28:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:28:46.563031 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5f815e42-ddd5-4fd4-bec2-187cf105caa3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:46.563759 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5f815e42-ddd5-4fd4-bec2-187cf105caa3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:46.595723 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-306e7ad0-2539-4e20-8192-766fe89fffbd req-624c2fcd-9c32-484b-aad9-42df431374ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c13b043-55ff-4372-99f9-1e4453cf6d65", "name": "network-vif-plugged", "status": "completed", "tag": "8d8d9a21-bb56-4e6b-b9fb-bdcf1e8ca8c2"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:46.597636 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:28:46.597636 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:28:46.606976 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-306e7ad0-2539-4e20-8192-766fe89fffbd req-624c2fcd-9c32-484b-aad9-42df431374ca service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:46.607710 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-306e7ad0-2539-4e20-8192-766fe89fffbd req-624c2fcd-9c32-484b-aad9-42df431374ca service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:46.622897 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-306e7ad0-2539-4e20-8192-766fe89fffbd req-624c2fcd-9c32-484b-aad9-42df431374ca service nova] Creating event network-vif-plugged:8d8d9a21-bb56-4e6b-b9fb-bdcf1e8ca8c2 for instance 2c13b043-55ff-4372-99f9-1e4453cf6d65 on hv-cinder-82204 Feb 08 17:28:46.628148 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-306e7ad0-2539-4e20-8192-766fe89fffbd req-624c2fcd-9c32-484b-aad9-42df431374ca service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035992 Feb 08 17:28:46.629329 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 27/55] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:28:46.649535 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5f815e42-ddd5-4fd4-bec2-187cf105caa3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:46.662267 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5f815e42-ddd5-4fd4-bec2-187cf105caa3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1237 microversion: 2.1 time: 0.103363 Feb 08 17:28:46.670951 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 29/56] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:46 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1237 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:46.931539 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-aa93047e-ac4a-44a0-accc-fe1b40cd2976 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:46.932209 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-aa93047e-ac4a-44a0-accc-fe1b40cd2976 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:46.939948 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa93047e-ac4a-44a0-accc-fe1b40cd2976 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:46.940281 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa93047e-ac4a-44a0-accc-fe1b40cd2976 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:46.941283 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa93047e-ac4a-44a0-accc-fe1b40cd2976 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:46.942058 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa93047e-ac4a-44a0-accc-fe1b40cd2976 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:47.179577 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-aa93047e-ac4a-44a0-accc-fe1b40cd2976 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:47.189497 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-aa93047e-ac4a-44a0-accc-fe1b40cd2976 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 0.262695 Feb 08 17:28:47.190257 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 28/57] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:46 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:47.222260 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8d21d053-c68f-46ed-8167-5d58e178e5a3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:47.223115 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8d21d053-c68f-46ed-8167-5d58e178e5a3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:47.231397 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d21d053-c68f-46ed-8167-5d58e178e5a3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:47.232015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d21d053-c68f-46ed-8167-5d58e178e5a3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:47.233482 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d21d053-c68f-46ed-8167-5d58e178e5a3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:47.234147 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d21d053-c68f-46ed-8167-5d58e178e5a3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:47.430755 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8d21d053-c68f-46ed-8167-5d58e178e5a3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:47.439206 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8d21d053-c68f-46ed-8167-5d58e178e5a3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:47.440761 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8d21d053-c68f-46ed-8167-5d58e178e5a3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:47.441948 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8d21d053-c68f-46ed-8167-5d58e178e5a3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.225183 Feb 08 17:28:47.442519 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 30/58] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:47 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:28:47.468417 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-44faccf1-95d5-48ae-8352-e0d70ab6bd9b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:47.469911 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-44faccf1-95d5-48ae-8352-e0d70ab6bd9b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:47.476729 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-44faccf1-95d5-48ae-8352-e0d70ab6bd9b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:47.477206 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-44faccf1-95d5-48ae-8352-e0d70ab6bd9b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:47.478290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-44faccf1-95d5-48ae-8352-e0d70ab6bd9b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:47.478805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-44faccf1-95d5-48ae-8352-e0d70ab6bd9b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:47.633578 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-44faccf1-95d5-48ae-8352-e0d70ab6bd9b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:47.641090 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-44faccf1-95d5-48ae-8352-e0d70ab6bd9b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.176436 Feb 08 17:28:47.641722 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 29/59] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:47 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:47.683882 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3ffca244-8984-4f66-a0b5-3a1617b0acbc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:47.684871 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3ffca244-8984-4f66-a0b5-3a1617b0acbc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:47.697310 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3ffca244-8984-4f66-a0b5-3a1617b0acbc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:47.701089 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3ffca244-8984-4f66-a0b5-3a1617b0acbc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:47.702554 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3ffca244-8984-4f66-a0b5-3a1617b0acbc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:47.706147 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3ffca244-8984-4f66-a0b5-3a1617b0acbc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:47.792331 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3ffca244-8984-4f66-a0b5-3a1617b0acbc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:47.800595 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3ffca244-8984-4f66-a0b5-3a1617b0acbc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1241 microversion: 2.1 time: 0.123601 Feb 08 17:28:47.801205 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 31/60] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:47 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:48.229069 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-36b0d538-a828-4dbf-832a-12f859583c18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:48.229846 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-36b0d538-a828-4dbf-832a-12f859583c18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:48.236653 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36b0d538-a828-4dbf-832a-12f859583c18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:48.237227 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36b0d538-a828-4dbf-832a-12f859583c18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:48.238118 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36b0d538-a828-4dbf-832a-12f859583c18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:48.238629 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36b0d538-a828-4dbf-832a-12f859583c18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:48.403193 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-36b0d538-a828-4dbf-832a-12f859583c18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:48.414309 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-36b0d538-a828-4dbf-832a-12f859583c18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 0.194058 Feb 08 17:28:48.415151 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 30/61] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:48 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:48.460528 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e1aa3326-912a-447d-a5bc-fca4fd63f77d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:48.461259 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-e1aa3326-912a-447d-a5bc-fca4fd63f77d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:48.467585 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1aa3326-912a-447d-a5bc-fca4fd63f77d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:48.468043 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1aa3326-912a-447d-a5bc-fca4fd63f77d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:48.468849 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1aa3326-912a-447d-a5bc-fca4fd63f77d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:48.469328 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1aa3326-912a-447d-a5bc-fca4fd63f77d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:48.645435 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e1aa3326-912a-447d-a5bc-fca4fd63f77d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:48.657554 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e1aa3326-912a-447d-a5bc-fca4fd63f77d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:48.659668 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e1aa3326-912a-447d-a5bc-fca4fd63f77d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:48.661010 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e1aa3326-912a-447d-a5bc-fca4fd63f77d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.204907 Feb 08 17:28:48.671838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-659213c3-e310-4d02-b7fd-e4f18a2b8dd0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:48.671838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-659213c3-e310-4d02-b7fd-e4f18a2b8dd0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:48.671838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-659213c3-e310-4d02-b7fd-e4f18a2b8dd0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:48.671838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-659213c3-e310-4d02-b7fd-e4f18a2b8dd0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:48.672477 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-659213c3-e310-4d02-b7fd-e4f18a2b8dd0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:48.672775 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 32/62] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:48 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:28:48.672876 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-659213c3-e310-4d02-b7fd-e4f18a2b8dd0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:48.828941 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c62c828b-1079-4543-877c-d38d9d6868ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:48.830139 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c62c828b-1079-4543-877c-d38d9d6868ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:48.843460 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c62c828b-1079-4543-877c-d38d9d6868ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:48.844281 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c62c828b-1079-4543-877c-d38d9d6868ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:48.845773 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c62c828b-1079-4543-877c-d38d9d6868ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:48.846682 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c62c828b-1079-4543-877c-d38d9d6868ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:48.954626 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-659213c3-e310-4d02-b7fd-e4f18a2b8dd0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:48.970958 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-659213c3-e310-4d02-b7fd-e4f18a2b8dd0 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.309303 Feb 08 17:28:48.974719 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 31/63] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:48 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:49.003795 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-c62c828b-1079-4543-877c-d38d9d6868ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:49.022607 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c62c828b-1079-4543-877c-d38d9d6868ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1241 microversion: 2.1 time: 0.198846 Feb 08 17:28:49.023951 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 33/64] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:48 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1241 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:49.463301 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4fc78c49-d814-4dc8-be6d-ffb31524dd37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:49.469051 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4fc78c49-d814-4dc8-be6d-ffb31524dd37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:49.486867 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4fc78c49-d814-4dc8-be6d-ffb31524dd37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:49.487795 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4fc78c49-d814-4dc8-be6d-ffb31524dd37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:49.490273 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4fc78c49-d814-4dc8-be6d-ffb31524dd37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:49.492974 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4fc78c49-d814-4dc8-be6d-ffb31524dd37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:49.683091 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d23a568b-34ba-40a4-a33c-e6afad24ea65 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:49.684145 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d23a568b-34ba-40a4-a33c-e6afad24ea65 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:49.716793 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d23a568b-34ba-40a4-a33c-e6afad24ea65 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:49.717819 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d23a568b-34ba-40a4-a33c-e6afad24ea65 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:49.722436 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d23a568b-34ba-40a4-a33c-e6afad24ea65 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:49.723501 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d23a568b-34ba-40a4-a33c-e6afad24ea65 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:49.952384 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4fc78c49-d814-4dc8-be6d-ffb31524dd37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:49.967409 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4fc78c49-d814-4dc8-be6d-ffb31524dd37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 0.533971 Feb 08 17:28:49.973447 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 32/65] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:49 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:50.003072 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9ff8e847-740d-44f8-bbc4-ec281ae0932b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:50.003738 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9ff8e847-740d-44f8-bbc4-ec281ae0932b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:50.010994 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ff8e847-740d-44f8-bbc4-ec281ae0932b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:50.011277 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ff8e847-740d-44f8-bbc4-ec281ae0932b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:50.012486 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ff8e847-740d-44f8-bbc4-ec281ae0932b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:50.012925 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ff8e847-740d-44f8-bbc4-ec281ae0932b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:50.094569 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d23a568b-34ba-40a4-a33c-e6afad24ea65 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:50.108711 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d23a568b-34ba-40a4-a33c-e6afad24ea65 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:50.112289 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d23a568b-34ba-40a4-a33c-e6afad24ea65 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:50.115740 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d23a568b-34ba-40a4-a33c-e6afad24ea65 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.439372 Feb 08 17:28:50.117911 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 34/66] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:49 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:28:50.133721 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-298422f7-3a1e-468a-9469-c0d53167b7f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:50.135142 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-298422f7-3a1e-468a-9469-c0d53167b7f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:50.153240 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-298422f7-3a1e-468a-9469-c0d53167b7f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:50.161569 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-298422f7-3a1e-468a-9469-c0d53167b7f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:50.164585 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-298422f7-3a1e-468a-9469-c0d53167b7f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:50.165949 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-298422f7-3a1e-468a-9469-c0d53167b7f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:50.287082 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9ff8e847-740d-44f8-bbc4-ec281ae0932b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:50.304570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9ff8e847-740d-44f8-bbc4-ec281ae0932b tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.304998 Feb 08 17:28:50.305996 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 33/67] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:49 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:50.389104 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-298422f7-3a1e-468a-9469-c0d53167b7f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:50.409903 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-298422f7-3a1e-468a-9469-c0d53167b7f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1289 microversion: 2.1 time: 0.289588 Feb 08 17:28:50.411353 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 35/68] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:50 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1289 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:50.558950 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-ef18a005-5890-4668-945c-172b1bb78f4c req-300d80d8-8226-40a0-9700-12bf67038314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73f173b-bae7-44a2-b686-0179e64e9c30", "tag": "72759e6a-9d50-4192-90ea-3e1d17bb4b78"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:50.563485 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:28:50.563485 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:28:50.587074 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-ef18a005-5890-4668-945c-172b1bb78f4c req-300d80d8-8226-40a0-9700-12bf67038314 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:50.589891 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-ef18a005-5890-4668-945c-172b1bb78f4c req-300d80d8-8226-40a0-9700-12bf67038314 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:50.637889 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-ef18a005-5890-4668-945c-172b1bb78f4c req-300d80d8-8226-40a0-9700-12bf67038314 service nova] Creating event network-changed:72759e6a-9d50-4192-90ea-3e1d17bb4b78 for instance c73f173b-bae7-44a2-b686-0179e64e9c30 on hv-cinder-82204 Feb 08 17:28:50.644653 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-ef18a005-5890-4668-945c-172b1bb78f4c req-300d80d8-8226-40a0-9700-12bf67038314 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094288 Feb 08 17:28:50.645612 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 34/69] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:28:50.993780 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0b8d774c-6972-40ca-910d-319583036672 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:50.997940 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0b8d774c-6972-40ca-910d-319583036672 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:51.032642 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0b8d774c-6972-40ca-910d-319583036672 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:51.036001 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0b8d774c-6972-40ca-910d-319583036672 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:51.041784 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0b8d774c-6972-40ca-910d-319583036672 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:51.044864 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0b8d774c-6972-40ca-910d-319583036672 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:51.142096 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d699e286-437b-4b71-885e-30ddd7dfb639 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:51.143325 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d699e286-437b-4b71-885e-30ddd7dfb639 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:51.174783 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d699e286-437b-4b71-885e-30ddd7dfb639 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:51.188122 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d699e286-437b-4b71-885e-30ddd7dfb639 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:51.189682 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d699e286-437b-4b71-885e-30ddd7dfb639 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:51.190482 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d699e286-437b-4b71-885e-30ddd7dfb639 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:51.481599 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0b8d774c-6972-40ca-910d-319583036672 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:51.496110 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0b8d774c-6972-40ca-910d-319583036672 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 0.512488 Feb 08 17:28:51.497096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 36/70] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:50 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:51.520811 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0e5d2188-8409-4b25-b063-126a7f440c3a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:51.522318 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0e5d2188-8409-4b25-b063-126a7f440c3a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:51.554108 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0e5d2188-8409-4b25-b063-126a7f440c3a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:51.556220 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0e5d2188-8409-4b25-b063-126a7f440c3a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:51.558335 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0e5d2188-8409-4b25-b063-126a7f440c3a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:51.559302 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0e5d2188-8409-4b25-b063-126a7f440c3a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:51.754855 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d699e286-437b-4b71-885e-30ddd7dfb639 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:51.781299 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d699e286-437b-4b71-885e-30ddd7dfb639 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:51.784243 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d699e286-437b-4b71-885e-30ddd7dfb639 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:51.791777 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d699e286-437b-4b71-885e-30ddd7dfb639 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.658238 Feb 08 17:28:51.792715 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 35/71] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:51 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:28:51.816069 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-db46b307-0abb-4e44-b733-15f5e848f3f2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:51.820747 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-db46b307-0abb-4e44-b733-15f5e848f3f2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:51.848949 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-db46b307-0abb-4e44-b733-15f5e848f3f2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:51.849895 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-db46b307-0abb-4e44-b733-15f5e848f3f2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:51.851302 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-db46b307-0abb-4e44-b733-15f5e848f3f2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:51.855687 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-db46b307-0abb-4e44-b733-15f5e848f3f2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:51.922833 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0e5d2188-8409-4b25-b063-126a7f440c3a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:51.940666 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0e5d2188-8409-4b25-b063-126a7f440c3a tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.429095 Feb 08 17:28:51.941799 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 37/72] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:51 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:52.106212 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-db46b307-0abb-4e44-b733-15f5e848f3f2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:52.115180 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-db46b307-0abb-4e44-b733-15f5e848f3f2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.315149 Feb 08 17:28:52.116578 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 36/73] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:51 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:52.523387 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ad85e27b-f3e9-47f0-91d3-7c6a9ff4840d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:52.524035 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ad85e27b-f3e9-47f0-91d3-7c6a9ff4840d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:52.530098 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ad85e27b-f3e9-47f0-91d3-7c6a9ff4840d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:52.530559 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ad85e27b-f3e9-47f0-91d3-7c6a9ff4840d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:52.531362 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ad85e27b-f3e9-47f0-91d3-7c6a9ff4840d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:52.531801 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ad85e27b-f3e9-47f0-91d3-7c6a9ff4840d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:52.557355 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-7012b916-d324-4a8a-82b8-e31c873a15c4 req-40df724d-7d34-4d07-8562-54e56f9db0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fe4eef-a72f-4590-8612-3fd439dd28e9", "name": "network-vif-plugged", "status": "completed", "tag": "6abb2636-5f5b-42a8-9a24-6721d7a23d2b"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:52.560607 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:28:52.560607 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:28:52.573423 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-7012b916-d324-4a8a-82b8-e31c873a15c4 req-40df724d-7d34-4d07-8562-54e56f9db0e2 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:52.574603 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-7012b916-d324-4a8a-82b8-e31c873a15c4 req-40df724d-7d34-4d07-8562-54e56f9db0e2 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:52.594868 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-7012b916-d324-4a8a-82b8-e31c873a15c4 req-40df724d-7d34-4d07-8562-54e56f9db0e2 service nova] Creating event network-vif-plugged:6abb2636-5f5b-42a8-9a24-6721d7a23d2b for instance 59fe4eef-a72f-4590-8612-3fd439dd28e9 on hv-cinder-82204 Feb 08 17:28:52.605399 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-7012b916-d324-4a8a-82b8-e31c873a15c4 req-40df724d-7d34-4d07-8562-54e56f9db0e2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052969 Feb 08 17:28:52.607406 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 37/74] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:28:52.715424 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ad85e27b-f3e9-47f0-91d3-7c6a9ff4840d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:52.729495 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ad85e27b-f3e9-47f0-91d3-7c6a9ff4840d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 0.209438 Feb 08 17:28:52.730562 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 38/75] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:52 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:52.813949 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-abce5bdf-9557-45c9-b273-47b24ec9101e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:52.814631 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-abce5bdf-9557-45c9-b273-47b24ec9101e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:52.821328 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-abce5bdf-9557-45c9-b273-47b24ec9101e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:52.822021 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-abce5bdf-9557-45c9-b273-47b24ec9101e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:52.822579 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-abce5bdf-9557-45c9-b273-47b24ec9101e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:52.823009 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-abce5bdf-9557-45c9-b273-47b24ec9101e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:52.966865 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-93795ef0-bd7a-4dc6-8bcd-f9e0a7f078c4 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:52.967481 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-93795ef0-bd7a-4dc6-8bcd-f9e0a7f078c4 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:52.974074 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-93795ef0-bd7a-4dc6-8bcd-f9e0a7f078c4 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:52.974759 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-93795ef0-bd7a-4dc6-8bcd-f9e0a7f078c4 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:52.976279 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-93795ef0-bd7a-4dc6-8bcd-f9e0a7f078c4 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:52.976857 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-93795ef0-bd7a-4dc6-8bcd-f9e0a7f078c4 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:52.983304 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-abce5bdf-9557-45c9-b273-47b24ec9101e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:52.993711 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-abce5bdf-9557-45c9-b273-47b24ec9101e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:52.996276 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-abce5bdf-9557-45c9-b273-47b24ec9101e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:52.997609 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-abce5bdf-9557-45c9-b273-47b24ec9101e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.187572 Feb 08 17:28:52.998380 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 38/76] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:52 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:28:53.137475 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7c5dd1c9-9d63-4147-98e7-f0f5995fe492 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:53.138449 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7c5dd1c9-9d63-4147-98e7-f0f5995fe492 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:53.143538 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-93795ef0-bd7a-4dc6-8bcd-f9e0a7f078c4 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:53.145524 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c5dd1c9-9d63-4147-98e7-f0f5995fe492 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:53.146180 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c5dd1c9-9d63-4147-98e7-f0f5995fe492 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:53.148168 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c5dd1c9-9d63-4147-98e7-f0f5995fe492 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:53.148798 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c5dd1c9-9d63-4147-98e7-f0f5995fe492 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:53.152205 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-93795ef0-bd7a-4dc6-8bcd-f9e0a7f078c4 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.190298 Feb 08 17:28:53.152803 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 39/77] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:52 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:53.298492 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7c5dd1c9-9d63-4147-98e7-f0f5995fe492 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:53.306172 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7c5dd1c9-9d63-4147-98e7-f0f5995fe492 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.172697 Feb 08 17:28:53.307074 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 39/78] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:53 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:53.747712 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b3c6a5db-ee52-4a59-bece-0615d13e177a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:53.748495 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b3c6a5db-ee52-4a59-bece-0615d13e177a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:53.754567 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3c6a5db-ee52-4a59-bece-0615d13e177a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:53.755015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3c6a5db-ee52-4a59-bece-0615d13e177a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:53.755807 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3c6a5db-ee52-4a59-bece-0615d13e177a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:53.756843 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3c6a5db-ee52-4a59-bece-0615d13e177a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:53.919259 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b3c6a5db-ee52-4a59-bece-0615d13e177a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:53.926870 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b3c6a5db-ee52-4a59-bece-0615d13e177a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 0.182928 Feb 08 17:28:53.927463 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 40/79] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:53 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:54.016123 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-cb81e226-aa81-41f1-b820-c78b50a56301 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:54.016781 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-cb81e226-aa81-41f1-b820-c78b50a56301 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:54.022991 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cb81e226-aa81-41f1-b820-c78b50a56301 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:54.023444 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cb81e226-aa81-41f1-b820-c78b50a56301 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:54.024240 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cb81e226-aa81-41f1-b820-c78b50a56301 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:54.024681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cb81e226-aa81-41f1-b820-c78b50a56301 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:54.172399 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b2dba6cd-6c93-451d-aa80-9c225f8696d8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:54.176759 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b2dba6cd-6c93-451d-aa80-9c225f8696d8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:54.191894 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b2dba6cd-6c93-451d-aa80-9c225f8696d8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:54.193228 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b2dba6cd-6c93-451d-aa80-9c225f8696d8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:54.195331 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b2dba6cd-6c93-451d-aa80-9c225f8696d8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:54.197047 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b2dba6cd-6c93-451d-aa80-9c225f8696d8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:54.301285 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-cb81e226-aa81-41f1-b820-c78b50a56301 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:54.330277 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-cb81e226-aa81-41f1-b820-c78b50a56301 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:54.333921 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-cb81e226-aa81-41f1-b820-c78b50a56301 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:54.336941 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-cb81e226-aa81-41f1-b820-c78b50a56301 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.324509 Feb 08 17:28:54.348986 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 40/80] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:54 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:28:54.367146 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-90b7e778-8c8c-4c7c-831e-26d043348ee8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:54.368677 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-90b7e778-8c8c-4c7c-831e-26d043348ee8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:54.389773 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-90b7e778-8c8c-4c7c-831e-26d043348ee8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:54.390853 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-90b7e778-8c8c-4c7c-831e-26d043348ee8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:54.393650 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-90b7e778-8c8c-4c7c-831e-26d043348ee8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:54.394776 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-90b7e778-8c8c-4c7c-831e-26d043348ee8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:55.013939 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b2dba6cd-6c93-451d-aa80-9c225f8696d8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:55.044613 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b2dba6cd-6c93-451d-aa80-9c225f8696d8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1314 microversion: 2.1 time: 0.869649 Feb 08 17:28:55.046358 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 41/81] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:54 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1314 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:55.055379 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-54ccc09b-1138-4513-9aa4-f09ed6740679 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:55.056543 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-54ccc09b-1138-4513-9aa4-f09ed6740679 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:55.067185 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-54ccc09b-1138-4513-9aa4-f09ed6740679 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:55.067990 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-54ccc09b-1138-4513-9aa4-f09ed6740679 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:55.070101 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-54ccc09b-1138-4513-9aa4-f09ed6740679 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:55.071165 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-54ccc09b-1138-4513-9aa4-f09ed6740679 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:55.210635 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-90b7e778-8c8c-4c7c-831e-26d043348ee8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:55.227220 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-90b7e778-8c8c-4c7c-831e-26d043348ee8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.875610 Feb 08 17:28:55.228569 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 41/82] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:54 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:55.380586 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-141441db-9bda-433c-9702-75b9b6a0eccb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:55.383635 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-141441db-9bda-433c-9702-75b9b6a0eccb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:55.404517 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-141441db-9bda-433c-9702-75b9b6a0eccb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:55.405597 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-141441db-9bda-433c-9702-75b9b6a0eccb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:55.407120 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-141441db-9bda-433c-9702-75b9b6a0eccb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:55.407660 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-141441db-9bda-433c-9702-75b9b6a0eccb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:55.453249 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-54ccc09b-1138-4513-9aa4-f09ed6740679 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:55.484925 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-54ccc09b-1138-4513-9aa4-f09ed6740679 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 0.436917 Feb 08 17:28:55.501306 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 42/83] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:55 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:55.808872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-141441db-9bda-433c-9702-75b9b6a0eccb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:55.859458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-141441db-9bda-433c-9702-75b9b6a0eccb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:55.865990 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-141441db-9bda-433c-9702-75b9b6a0eccb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:55.867889 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-141441db-9bda-433c-9702-75b9b6a0eccb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.502108 Feb 08 17:28:55.881747 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 42/84] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:55 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:28:56.066928 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-4932ce70-903a-493d-93ce-e973c2f3bddf req-4d4776df-935e-4c70-b183-bd92eb16dd52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8921a8f3-fa2c-43e4-90fa-a8a936c1eda0", "tag": "998b80e9-4624-47bb-91e8-25b96f1bc969"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:56.081398 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1ca1241d-f221-4a87-b464-6a724b6dee59 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:56.082785 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1ca1241d-f221-4a87-b464-6a724b6dee59 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:56.086317 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:28:56.086317 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:28:56.111366 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1ca1241d-f221-4a87-b464-6a724b6dee59 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:56.118245 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1ca1241d-f221-4a87-b464-6a724b6dee59 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:56.120017 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-4932ce70-903a-493d-93ce-e973c2f3bddf req-4d4776df-935e-4c70-b183-bd92eb16dd52 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:56.121132 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-4932ce70-903a-493d-93ce-e973c2f3bddf req-4d4776df-935e-4c70-b183-bd92eb16dd52 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:56.125922 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1ca1241d-f221-4a87-b464-6a724b6dee59 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:56.132911 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1ca1241d-f221-4a87-b464-6a724b6dee59 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:56.151988 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-4932ce70-903a-493d-93ce-e973c2f3bddf req-4d4776df-935e-4c70-b183-bd92eb16dd52 service nova] Creating event network-changed:998b80e9-4624-47bb-91e8-25b96f1bc969 for instance 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 on hv-cinder-82204 Feb 08 17:28:56.159478 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-4932ce70-903a-493d-93ce-e973c2f3bddf req-4d4776df-935e-4c70-b183-bd92eb16dd52 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105530 Feb 08 17:28:56.162134 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 43/85] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:28:56.277517 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-927c7316-e009-4620-9779-f6656e3f9e3f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:56.279956 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-927c7316-e009-4620-9779-f6656e3f9e3f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:56.306372 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-927c7316-e009-4620-9779-f6656e3f9e3f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:56.309849 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-927c7316-e009-4620-9779-f6656e3f9e3f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:56.322146 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-927c7316-e009-4620-9779-f6656e3f9e3f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:56.326064 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-927c7316-e009-4620-9779-f6656e3f9e3f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:56.607063 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1ca1241d-f221-4a87-b464-6a724b6dee59 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:56.634415 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1ca1241d-f221-4a87-b464-6a724b6dee59 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1502 microversion: 2.1 time: 0.560311 Feb 08 17:28:56.651798 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 43/86] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:56 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1502 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:56.682083 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6f802715-3c6a-462d-a3fe-b5738e12e8df tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:56.683290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6f802715-3c6a-462d-a3fe-b5738e12e8df tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:56.719506 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f802715-3c6a-462d-a3fe-b5738e12e8df tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:56.728121 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f802715-3c6a-462d-a3fe-b5738e12e8df tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:56.729626 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f802715-3c6a-462d-a3fe-b5738e12e8df tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:56.730398 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f802715-3c6a-462d-a3fe-b5738e12e8df tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:56.912299 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-927c7316-e009-4620-9779-f6656e3f9e3f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:56.929290 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-927c7316-e009-4620-9779-f6656e3f9e3f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.670669 Feb 08 17:28:56.931214 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 44/87] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:56 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:56.940882 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-dc5ac33b-1cf7-4a74-b2d6-940efdc571b8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:56.942462 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-dc5ac33b-1cf7-4a74-b2d6-940efdc571b8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:56.954424 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc5ac33b-1cf7-4a74-b2d6-940efdc571b8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:56.955718 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc5ac33b-1cf7-4a74-b2d6-940efdc571b8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:56.958012 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc5ac33b-1cf7-4a74-b2d6-940efdc571b8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:56.959233 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc5ac33b-1cf7-4a74-b2d6-940efdc571b8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:57.421475 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-dc5ac33b-1cf7-4a74-b2d6-940efdc571b8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:57.449307 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-dc5ac33b-1cf7-4a74-b2d6-940efdc571b8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:57.453440 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-dc5ac33b-1cf7-4a74-b2d6-940efdc571b8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:57.455936 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-dc5ac33b-1cf7-4a74-b2d6-940efdc571b8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.522387 Feb 08 17:28:57.457262 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 45/88] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:56 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:28:57.723972 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6f802715-3c6a-462d-a3fe-b5738e12e8df tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:57.734303 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6f802715-3c6a-462d-a3fe-b5738e12e8df tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1322 microversion: 2.1 time: 1.080654 Feb 08 17:28:57.736704 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 44/89] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:56 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1322 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:57.958106 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-581f5e16-4892-4f18-9440-7520fa346555 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:57.959947 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-581f5e16-4892-4f18-9440-7520fa346555 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:57.969621 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-581f5e16-4892-4f18-9440-7520fa346555 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:57.970797 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-581f5e16-4892-4f18-9440-7520fa346555 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:57.972059 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-581f5e16-4892-4f18-9440-7520fa346555 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:57.972953 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-581f5e16-4892-4f18-9440-7520fa346555 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:58.181850 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-581f5e16-4892-4f18-9440-7520fa346555 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:58.195195 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-581f5e16-4892-4f18-9440-7520fa346555 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.243248 Feb 08 17:28:58.196188 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 46/90] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:57 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:58.485294 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-86580ba8-497d-4227-8784-8dfff0b176fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:58.486216 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-86580ba8-497d-4227-8784-8dfff0b176fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:58.493684 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-86580ba8-497d-4227-8784-8dfff0b176fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:58.494399 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-86580ba8-497d-4227-8784-8dfff0b176fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:58.495409 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-86580ba8-497d-4227-8784-8dfff0b176fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:58.495995 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-86580ba8-497d-4227-8784-8dfff0b176fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:58.766248 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7c34e038-d854-410d-9522-59ed7da84426 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:58.767500 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7c34e038-d854-410d-9522-59ed7da84426 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:58.792354 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-86580ba8-497d-4227-8784-8dfff0b176fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:58.794136 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7c34e038-d854-410d-9522-59ed7da84426 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:58.795388 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7c34e038-d854-410d-9522-59ed7da84426 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:58.797515 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7c34e038-d854-410d-9522-59ed7da84426 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:58.798645 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7c34e038-d854-410d-9522-59ed7da84426 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:58.807558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-86580ba8-497d-4227-8784-8dfff0b176fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:58.815337 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-86580ba8-497d-4227-8784-8dfff0b176fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:58.819676 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-86580ba8-497d-4227-8784-8dfff0b176fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.337632 Feb 08 17:28:58.824127 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 45/91] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:58 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:28:59.026486 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-7c34e038-d854-410d-9522-59ed7da84426 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:59.034626 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7c34e038-d854-410d-9522-59ed7da84426 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1516 microversion: 2.1 time: 0.277337 Feb 08 17:28:59.035215 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 47/92] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:58 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1516 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:28:59.061583 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d929f125-f2d8-4043-8247-4d639c61888a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:28:59.063336 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d929f125-f2d8-4043-8247-4d639c61888a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:59.074240 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d929f125-f2d8-4043-8247-4d639c61888a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:59.075065 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d929f125-f2d8-4043-8247-4d639c61888a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:59.076499 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d929f125-f2d8-4043-8247-4d639c61888a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:59.077596 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d929f125-f2d8-4043-8247-4d639c61888a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:59.197716 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-d929f125-f2d8-4043-8247-4d639c61888a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lazy-loading 'flavor' on Instance uuid 59fe4eef-a72f-4590-8612-3fd439dd28e9 {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:28:59.216049 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cbd87ada-b469-48f6-bf41-b36bd63fb606 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:59.217459 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-cbd87ada-b469-48f6-bf41-b36bd63fb606 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:59.226889 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cbd87ada-b469-48f6-bf41-b36bd63fb606 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:59.227332 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cbd87ada-b469-48f6-bf41-b36bd63fb606 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:59.228664 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cbd87ada-b469-48f6-bf41-b36bd63fb606 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:59.229516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cbd87ada-b469-48f6-bf41-b36bd63fb606 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:59.462718 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cbd87ada-b469-48f6-bf41-b36bd63fb606 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:28:59.467299 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d929f125-f2d8-4043-8247-4d639c61888a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "POST /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9/action" status: 200 len: 32 microversion: 2.1 time: 0.414697 Feb 08 17:28:59.468916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 46/93] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:28:59 2022] POST /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9/action => generated 32 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 17:28:59.474147 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cbd87ada-b469-48f6-bf41-b36bd63fb606 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.263563 Feb 08 17:28:59.475868 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 48/94] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:59 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:28:59.499361 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ad5e2a9f-89b9-45d4-8751-4336fcc27e65 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:59.500543 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ad5e2a9f-89b9-45d4-8751-4336fcc27e65 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:59.511920 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ad5e2a9f-89b9-45d4-8751-4336fcc27e65 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:59.512651 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ad5e2a9f-89b9-45d4-8751-4336fcc27e65 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:59.514024 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ad5e2a9f-89b9-45d4-8751-4336fcc27e65 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:59.514554 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ad5e2a9f-89b9-45d4-8751-4336fcc27e65 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:59.863586 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2b3ac4ee-07fb-4886-8b94-4d7fa5e68bf8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:28:59.864320 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2b3ac4ee-07fb-4886-8b94-4d7fa5e68bf8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:28:59.894371 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2b3ac4ee-07fb-4886-8b94-4d7fa5e68bf8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:59.895124 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2b3ac4ee-07fb-4886-8b94-4d7fa5e68bf8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:28:59.911778 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2b3ac4ee-07fb-4886-8b94-4d7fa5e68bf8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:28:59.913177 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2b3ac4ee-07fb-4886-8b94-4d7fa5e68bf8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:00.009094 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ad5e2a9f-89b9-45d4-8751-4336fcc27e65 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:00.018227 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ad5e2a9f-89b9-45d4-8751-4336fcc27e65 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.526983 Feb 08 17:29:00.018914 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 47/95] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:28:59 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:00.151696 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2b3ac4ee-07fb-4886-8b94-4d7fa5e68bf8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:00.164780 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2b3ac4ee-07fb-4886-8b94-4d7fa5e68bf8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:00.167779 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2b3ac4ee-07fb-4886-8b94-4d7fa5e68bf8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:00.169669 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2b3ac4ee-07fb-4886-8b94-4d7fa5e68bf8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.313525 Feb 08 17:29:00.170574 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 49/96] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:28:59 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:29:00.503154 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-738945b7-981d-4a11-b094-3fb125600cd4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:00.504543 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-738945b7-981d-4a11-b094-3fb125600cd4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:00.515703 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-738945b7-981d-4a11-b094-3fb125600cd4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:00.516589 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-738945b7-981d-4a11-b094-3fb125600cd4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:00.518090 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-738945b7-981d-4a11-b094-3fb125600cd4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:00.518977 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-738945b7-981d-4a11-b094-3fb125600cd4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:00.772063 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-738945b7-981d-4a11-b094-3fb125600cd4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:00.780979 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-738945b7-981d-4a11-b094-3fb125600cd4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.284162 Feb 08 17:29:00.780979 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 48/97] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:00 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:01.048430 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-becf289c-5d24-4b4c-a0bf-76540297a56c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:01.049557 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-becf289c-5d24-4b4c-a0bf-76540297a56c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:01.060548 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-becf289c-5d24-4b4c-a0bf-76540297a56c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:01.061407 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-becf289c-5d24-4b4c-a0bf-76540297a56c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:01.062827 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-becf289c-5d24-4b4c-a0bf-76540297a56c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:01.063591 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-becf289c-5d24-4b4c-a0bf-76540297a56c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:01.202991 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0a9a5ce7-7376-44e1-a376-4882a0e40096 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:01.204269 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0a9a5ce7-7376-44e1-a376-4882a0e40096 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:01.216035 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a9a5ce7-7376-44e1-a376-4882a0e40096 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:01.217300 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a9a5ce7-7376-44e1-a376-4882a0e40096 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:01.219452 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a9a5ce7-7376-44e1-a376-4882a0e40096 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:01.220797 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a9a5ce7-7376-44e1-a376-4882a0e40096 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:01.354854 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-becf289c-5d24-4b4c-a0bf-76540297a56c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:01.372216 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-becf289c-5d24-4b4c-a0bf-76540297a56c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.329968 Feb 08 17:29:01.386542 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 50/98] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:01 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:01.536423 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0a9a5ce7-7376-44e1-a376-4882a0e40096 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:01.558353 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0a9a5ce7-7376-44e1-a376-4882a0e40096 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:01.561127 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0a9a5ce7-7376-44e1-a376-4882a0e40096 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:01.563702 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0a9a5ce7-7376-44e1-a376-4882a0e40096 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.368179 Feb 08 17:29:01.565301 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 49/99] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:01 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:29:01.808784 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-337963f0-1a50-424d-ac20-59fe26ca087f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:01.810194 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-337963f0-1a50-424d-ac20-59fe26ca087f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:01.828524 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-337963f0-1a50-424d-ac20-59fe26ca087f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:01.834920 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-337963f0-1a50-424d-ac20-59fe26ca087f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:01.836373 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-337963f0-1a50-424d-ac20-59fe26ca087f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:01.837431 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-337963f0-1a50-424d-ac20-59fe26ca087f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:02.392630 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-337963f0-1a50-424d-ac20-59fe26ca087f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:02.405140 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d786d89e-f1cf-44ae-b29a-02027d22aa57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:02.406914 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d786d89e-f1cf-44ae-b29a-02027d22aa57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:02.409605 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-337963f0-1a50-424d-ac20-59fe26ca087f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.606759 Feb 08 17:29:02.421957 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 51/100] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:01 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:02.428850 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d786d89e-f1cf-44ae-b29a-02027d22aa57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:02.429714 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d786d89e-f1cf-44ae-b29a-02027d22aa57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:02.437661 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d786d89e-f1cf-44ae-b29a-02027d22aa57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:02.438727 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d786d89e-f1cf-44ae-b29a-02027d22aa57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:02.602515 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-24407494-d439-433b-9a5b-fffabaf10ee7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:02.604925 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-24407494-d439-433b-9a5b-fffabaf10ee7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:02.618531 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24407494-d439-433b-9a5b-fffabaf10ee7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:02.619298 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24407494-d439-433b-9a5b-fffabaf10ee7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:02.620780 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24407494-d439-433b-9a5b-fffabaf10ee7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:02.621618 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24407494-d439-433b-9a5b-fffabaf10ee7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:02.702244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d786d89e-f1cf-44ae-b29a-02027d22aa57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:02.729955 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d786d89e-f1cf-44ae-b29a-02027d22aa57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.331579 Feb 08 17:29:02.746029 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 50/101] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:02 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:02.908370 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-24407494-d439-433b-9a5b-fffabaf10ee7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:02.922043 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-24407494-d439-433b-9a5b-fffabaf10ee7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:02.924488 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-24407494-d439-433b-9a5b-fffabaf10ee7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:02.927962 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-24407494-d439-433b-9a5b-fffabaf10ee7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.335295 Feb 08 17:29:02.930043 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 52/102] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:02 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:29:03.292075 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-17883c75-f483-4d80-b956-2a0f32c319a2 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2322cd8-ca9b-489e-a034-26a46cbd40d3"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:29:03.295785 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-17883c75-f483-4d80-b956-2a0f32c319a2 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:03.305600 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-17883c75-f483-4d80-b956-2a0f32c319a2 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:03.306587 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-17883c75-f483-4d80-b956-2a0f32c319a2 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:03.329424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-17883c75-f483-4d80-b956-2a0f32c319a2 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:03.330491 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-17883c75-f483-4d80-b956-2a0f32c319a2 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:03.442713 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-27a4b289-777f-4c7b-98c9-47488cc00f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:03.444348 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-27a4b289-777f-4c7b-98c9-47488cc00f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:03.473894 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-27a4b289-777f-4c7b-98c9-47488cc00f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:03.476265 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-27a4b289-777f-4c7b-98c9-47488cc00f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:03.479887 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-27a4b289-777f-4c7b-98c9-47488cc00f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:03.485313 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-27a4b289-777f-4c7b-98c9-47488cc00f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:03.806426 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-27a4b289-777f-4c7b-98c9-47488cc00f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:03.820996 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-27a4b289-777f-4c7b-98c9-47488cc00f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.384979 Feb 08 17:29:03.822054 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 53/103] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:03 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:03.829835 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6bb6479f-c4d2-4723-9278-ec23eec0ba9c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:03.831073 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6bb6479f-c4d2-4723-9278-ec23eec0ba9c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:03.840275 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6bb6479f-c4d2-4723-9278-ec23eec0ba9c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:03.841447 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6bb6479f-c4d2-4723-9278-ec23eec0ba9c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:03.843078 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6bb6479f-c4d2-4723-9278-ec23eec0ba9c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:03.844064 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6bb6479f-c4d2-4723-9278-ec23eec0ba9c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:04.070950 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6bb6479f-c4d2-4723-9278-ec23eec0ba9c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:04.092291 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6bb6479f-c4d2-4723-9278-ec23eec0ba9c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.267435 Feb 08 17:29:04.094667 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 54/104] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:03 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:04.105977 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a484853e-2c98-4b92-b7f4-7f72fe441740 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:04.109327 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a484853e-2c98-4b92-b7f4-7f72fe441740 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:04.123150 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a484853e-2c98-4b92-b7f4-7f72fe441740 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:04.123565 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a484853e-2c98-4b92-b7f4-7f72fe441740 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:04.125204 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a484853e-2c98-4b92-b7f4-7f72fe441740 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:04.125994 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a484853e-2c98-4b92-b7f4-7f72fe441740 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:04.246801 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-17883c75-f483-4d80-b956-2a0f32c319a2 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "POST /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.958263 Feb 08 17:29:04.249477 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 51/105] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:29:03 2022] POST /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65/os-volume_attachments => generated 194 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:04.257785 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-7f3ffc5c-e573-47ef-a1c6-2dc661474142 req-7ddc2c2f-f79c-4bdb-abb0-7004d5b29145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73f173b-bae7-44a2-b686-0179e64e9c30", "name": "network-vif-plugged", "status": "completed", "tag": "72759e6a-9d50-4192-90ea-3e1d17bb4b78"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:29:04.261098 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:29:04.261098 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:29:04.276602 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-7f3ffc5c-e573-47ef-a1c6-2dc661474142 req-7ddc2c2f-f79c-4bdb-abb0-7004d5b29145 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:04.277539 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-7f3ffc5c-e573-47ef-a1c6-2dc661474142 req-7ddc2c2f-f79c-4bdb-abb0-7004d5b29145 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:04.308405 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-7f3ffc5c-e573-47ef-a1c6-2dc661474142 req-7ddc2c2f-f79c-4bdb-abb0-7004d5b29145 service nova] Creating event network-vif-plugged:72759e6a-9d50-4192-90ea-3e1d17bb4b78 for instance c73f173b-bae7-44a2-b686-0179e64e9c30 on hv-cinder-82204 Feb 08 17:29:04.318523 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-7f3ffc5c-e573-47ef-a1c6-2dc661474142 req-7ddc2c2f-f79c-4bdb-abb0-7004d5b29145 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066020 Feb 08 17:29:04.321481 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 52/106] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:04.467002 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a484853e-2c98-4b92-b7f4-7f72fe441740 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:04.481539 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a484853e-2c98-4b92-b7f4-7f72fe441740 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:04.484843 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a484853e-2c98-4b92-b7f4-7f72fe441740 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:04.486858 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a484853e-2c98-4b92-b7f4-7f72fe441740 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.389646 Feb 08 17:29:04.488291 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 55/107] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:04 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:29:04.854523 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b1ae9d68-0fa1-47ea-85a8-4eb1569af412 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:04.855708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-b1ae9d68-0fa1-47ea-85a8-4eb1569af412 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:04.880510 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b1ae9d68-0fa1-47ea-85a8-4eb1569af412 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:04.885244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b1ae9d68-0fa1-47ea-85a8-4eb1569af412 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:04.886902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b1ae9d68-0fa1-47ea-85a8-4eb1569af412 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:04.889947 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b1ae9d68-0fa1-47ea-85a8-4eb1569af412 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:05.121057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-013932bd-7db2-45b1-b7ac-cdd356628b68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:05.122334 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-013932bd-7db2-45b1-b7ac-cdd356628b68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:05.130320 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-013932bd-7db2-45b1-b7ac-cdd356628b68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:05.130978 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-013932bd-7db2-45b1-b7ac-cdd356628b68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:05.132607 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-013932bd-7db2-45b1-b7ac-cdd356628b68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:05.133609 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-013932bd-7db2-45b1-b7ac-cdd356628b68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:05.211807 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b1ae9d68-0fa1-47ea-85a8-4eb1569af412 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:05.225991 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b1ae9d68-0fa1-47ea-85a8-4eb1569af412 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.381683 Feb 08 17:29:05.227321 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 53/108] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:04 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:05.519324 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e8dca83b-3839-423e-b06c-c6997ca51de1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:05.520226 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e8dca83b-3839-423e-b06c-c6997ca51de1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:05.528039 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e8dca83b-3839-423e-b06c-c6997ca51de1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:05.528629 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e8dca83b-3839-423e-b06c-c6997ca51de1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:05.529621 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e8dca83b-3839-423e-b06c-c6997ca51de1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:05.530380 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e8dca83b-3839-423e-b06c-c6997ca51de1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:05.602110 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-013932bd-7db2-45b1-b7ac-cdd356628b68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:05.613476 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-013932bd-7db2-45b1-b7ac-cdd356628b68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.496353 Feb 08 17:29:05.614264 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 56/109] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:05 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:05.710293 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e8dca83b-3839-423e-b06c-c6997ca51de1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:05.719175 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e8dca83b-3839-423e-b06c-c6997ca51de1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:05.720760 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e8dca83b-3839-423e-b06c-c6997ca51de1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:05.721932 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e8dca83b-3839-423e-b06c-c6997ca51de1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.208612 Feb 08 17:29:05.722505 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 54/110] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:05 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:29:06.253419 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ce722a9e-f005-40f5-971d-8ffb999ca31d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:06.254047 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ce722a9e-f005-40f5-971d-8ffb999ca31d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:06.261201 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ce722a9e-f005-40f5-971d-8ffb999ca31d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:06.261652 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ce722a9e-f005-40f5-971d-8ffb999ca31d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:06.262441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ce722a9e-f005-40f5-971d-8ffb999ca31d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:06.263283 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ce722a9e-f005-40f5-971d-8ffb999ca31d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:06.465080 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ce722a9e-f005-40f5-971d-8ffb999ca31d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:06.474771 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ce722a9e-f005-40f5-971d-8ffb999ca31d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.225503 Feb 08 17:29:06.476067 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 57/111] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:06 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:06.633810 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2f64d47f-5318-4141-8809-f2b48734bafd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:06.634607 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2f64d47f-5318-4141-8809-f2b48734bafd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:06.641104 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f64d47f-5318-4141-8809-f2b48734bafd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:06.641577 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f64d47f-5318-4141-8809-f2b48734bafd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:06.642370 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f64d47f-5318-4141-8809-f2b48734bafd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:06.642879 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f64d47f-5318-4141-8809-f2b48734bafd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:06.744756 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-96e25084-e9e6-4cb7-8043-a56c65b6859e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:06.745481 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-96e25084-e9e6-4cb7-8043-a56c65b6859e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:06.753220 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-96e25084-e9e6-4cb7-8043-a56c65b6859e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:06.753721 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-96e25084-e9e6-4cb7-8043-a56c65b6859e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:06.763611 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-96e25084-e9e6-4cb7-8043-a56c65b6859e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:06.763611 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-96e25084-e9e6-4cb7-8043-a56c65b6859e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:06.840185 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2f64d47f-5318-4141-8809-f2b48734bafd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:06.852864 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2f64d47f-5318-4141-8809-f2b48734bafd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.223059 Feb 08 17:29:06.853681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 55/112] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:06 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:06.987883 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-96e25084-e9e6-4cb7-8043-a56c65b6859e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:07.002626 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-96e25084-e9e6-4cb7-8043-a56c65b6859e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:07.005583 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-96e25084-e9e6-4cb7-8043-a56c65b6859e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:07.008267 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-96e25084-e9e6-4cb7-8043-a56c65b6859e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.270711 Feb 08 17:29:07.009364 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 58/113] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:06 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:29:07.498210 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2702dbb8-57c3-4591-adb4-0ae971b8842f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:07.498812 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2702dbb8-57c3-4591-adb4-0ae971b8842f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:07.505039 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2702dbb8-57c3-4591-adb4-0ae971b8842f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:07.505511 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2702dbb8-57c3-4591-adb4-0ae971b8842f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:07.506292 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2702dbb8-57c3-4591-adb4-0ae971b8842f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:07.506729 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2702dbb8-57c3-4591-adb4-0ae971b8842f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:07.702503 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2702dbb8-57c3-4591-adb4-0ae971b8842f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:07.714114 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2702dbb8-57c3-4591-adb4-0ae971b8842f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.219222 Feb 08 17:29:07.715145 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 56/114] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:07 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:07.880824 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3bbfb514-3a53-47f2-916a-c6b34a3cfc3d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:07.882519 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3bbfb514-3a53-47f2-916a-c6b34a3cfc3d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:07.892626 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3bbfb514-3a53-47f2-916a-c6b34a3cfc3d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:07.893441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3bbfb514-3a53-47f2-916a-c6b34a3cfc3d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:07.894813 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3bbfb514-3a53-47f2-916a-c6b34a3cfc3d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:07.895584 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3bbfb514-3a53-47f2-916a-c6b34a3cfc3d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:08.030929 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f36fe983-837d-4029-ae1a-4d1d973e436e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:08.031713 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f36fe983-837d-4029-ae1a-4d1d973e436e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:08.039273 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f36fe983-837d-4029-ae1a-4d1d973e436e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:08.039957 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f36fe983-837d-4029-ae1a-4d1d973e436e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:08.040938 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f36fe983-837d-4029-ae1a-4d1d973e436e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:08.041503 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f36fe983-837d-4029-ae1a-4d1d973e436e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:08.084262 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3bbfb514-3a53-47f2-916a-c6b34a3cfc3d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:08.097721 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3bbfb514-3a53-47f2-916a-c6b34a3cfc3d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.223467 Feb 08 17:29:08.099159 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 59/115] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:07 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:08.244121 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f36fe983-837d-4029-ae1a-4d1d973e436e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:08.252650 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f36fe983-837d-4029-ae1a-4d1d973e436e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:08.254264 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f36fe983-837d-4029-ae1a-4d1d973e436e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:08.255412 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f36fe983-837d-4029-ae1a-4d1d973e436e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.228628 Feb 08 17:29:08.256018 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 57/116] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:08 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:29:08.735123 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2eb9d472-f06f-4d68-adfc-55b2eed66e6f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:08.736259 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2eb9d472-f06f-4d68-adfc-55b2eed66e6f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:08.747098 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2eb9d472-f06f-4d68-adfc-55b2eed66e6f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:08.747655 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2eb9d472-f06f-4d68-adfc-55b2eed66e6f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:08.748864 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2eb9d472-f06f-4d68-adfc-55b2eed66e6f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:08.749701 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2eb9d472-f06f-4d68-adfc-55b2eed66e6f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:08.978939 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2eb9d472-f06f-4d68-adfc-55b2eed66e6f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:08.991251 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2eb9d472-f06f-4d68-adfc-55b2eed66e6f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.262425 Feb 08 17:29:08.992065 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 60/117] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:08 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:09.125044 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4ba6ace1-ff1d-472d-b430-7ab2959a3e1c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:09.126321 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4ba6ace1-ff1d-472d-b430-7ab2959a3e1c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:09.138379 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4ba6ace1-ff1d-472d-b430-7ab2959a3e1c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:09.139271 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4ba6ace1-ff1d-472d-b430-7ab2959a3e1c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:09.140701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4ba6ace1-ff1d-472d-b430-7ab2959a3e1c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:09.141728 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4ba6ace1-ff1d-472d-b430-7ab2959a3e1c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:09.277409 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-907ba16f-a7f0-4e47-be89-8bc7348f9faf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:09.278261 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-907ba16f-a7f0-4e47-be89-8bc7348f9faf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:09.286429 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-907ba16f-a7f0-4e47-be89-8bc7348f9faf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:09.287264 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-907ba16f-a7f0-4e47-be89-8bc7348f9faf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:09.288158 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-907ba16f-a7f0-4e47-be89-8bc7348f9faf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:09.288626 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-907ba16f-a7f0-4e47-be89-8bc7348f9faf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:09.339569 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4ba6ace1-ff1d-472d-b430-7ab2959a3e1c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:09.354699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4ba6ace1-ff1d-472d-b430-7ab2959a3e1c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.235947 Feb 08 17:29:09.355764 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 58/118] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:09 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:09.580012 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-907ba16f-a7f0-4e47-be89-8bc7348f9faf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:09.589436 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-907ba16f-a7f0-4e47-be89-8bc7348f9faf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:09.590938 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-907ba16f-a7f0-4e47-be89-8bc7348f9faf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:09.592042 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-907ba16f-a7f0-4e47-be89-8bc7348f9faf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.318547 Feb 08 17:29:09.592608 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 61/119] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:09 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:29:10.018945 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-11af7b36-989a-4e6b-82cf-33872c6ae8b1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:10.020130 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-11af7b36-989a-4e6b-82cf-33872c6ae8b1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:10.030593 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-11af7b36-989a-4e6b-82cf-33872c6ae8b1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:10.031487 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-11af7b36-989a-4e6b-82cf-33872c6ae8b1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:10.032931 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-11af7b36-989a-4e6b-82cf-33872c6ae8b1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:10.033797 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-11af7b36-989a-4e6b-82cf-33872c6ae8b1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:10.211774 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-11af7b36-989a-4e6b-82cf-33872c6ae8b1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:10.219343 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-11af7b36-989a-4e6b-82cf-33872c6ae8b1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.207757 Feb 08 17:29:10.219951 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 59/120] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:10 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:10.377993 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8c05355f-ea65-4ddb-abc4-b3ce1a35fc8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:10.378811 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8c05355f-ea65-4ddb-abc4-b3ce1a35fc8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:10.385131 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8c05355f-ea65-4ddb-abc4-b3ce1a35fc8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:10.385610 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8c05355f-ea65-4ddb-abc4-b3ce1a35fc8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:10.386403 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8c05355f-ea65-4ddb-abc4-b3ce1a35fc8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:10.386842 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8c05355f-ea65-4ddb-abc4-b3ce1a35fc8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:10.561831 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8c05355f-ea65-4ddb-abc4-b3ce1a35fc8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:10.571719 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8c05355f-ea65-4ddb-abc4-b3ce1a35fc8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.197568 Feb 08 17:29:10.572456 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 62/121] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:10 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:10.610169 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-14f5573c-0983-4bd0-b984-3750f2c84ae3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:10.610946 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-14f5573c-0983-4bd0-b984-3750f2c84ae3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:10.618334 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-14f5573c-0983-4bd0-b984-3750f2c84ae3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:10.618780 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-14f5573c-0983-4bd0-b984-3750f2c84ae3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:10.619562 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-14f5573c-0983-4bd0-b984-3750f2c84ae3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:10.619994 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-14f5573c-0983-4bd0-b984-3750f2c84ae3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:10.789034 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-14f5573c-0983-4bd0-b984-3750f2c84ae3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:10.797674 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-14f5573c-0983-4bd0-b984-3750f2c84ae3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:10.800065 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-14f5573c-0983-4bd0-b984-3750f2c84ae3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:10.801928 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-14f5573c-0983-4bd0-b984-3750f2c84ae3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.195473 Feb 08 17:29:10.802793 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 60/122] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:10 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:29:11.236450 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-877dff4a-8027-4eab-ab31-1fa195e405d1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:11.237265 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-877dff4a-8027-4eab-ab31-1fa195e405d1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:11.249003 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-877dff4a-8027-4eab-ab31-1fa195e405d1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:11.249837 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-877dff4a-8027-4eab-ab31-1fa195e405d1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:11.251219 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-877dff4a-8027-4eab-ab31-1fa195e405d1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:11.251926 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-877dff4a-8027-4eab-ab31-1fa195e405d1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:11.434962 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-877dff4a-8027-4eab-ab31-1fa195e405d1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:11.453088 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-877dff4a-8027-4eab-ab31-1fa195e405d1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.220361 Feb 08 17:29:11.453778 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 63/123] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:11 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:11.590469 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-dd508704-e581-4eb6-9280-86a8450a13ae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:11.592529 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-dd508704-e581-4eb6-9280-86a8450a13ae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:11.598516 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dd508704-e581-4eb6-9280-86a8450a13ae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:11.598965 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dd508704-e581-4eb6-9280-86a8450a13ae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:11.599754 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dd508704-e581-4eb6-9280-86a8450a13ae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:11.600223 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dd508704-e581-4eb6-9280-86a8450a13ae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:11.771666 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-dd508704-e581-4eb6-9280-86a8450a13ae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:11.783991 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-dd508704-e581-4eb6-9280-86a8450a13ae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.196710 Feb 08 17:29:11.785055 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 61/124] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:11 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:11.822751 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-39def11c-3502-42d6-881c-b0decd243cfb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:11.823411 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-39def11c-3502-42d6-881c-b0decd243cfb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:11.830212 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-39def11c-3502-42d6-881c-b0decd243cfb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:11.830691 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-39def11c-3502-42d6-881c-b0decd243cfb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:11.831485 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-39def11c-3502-42d6-881c-b0decd243cfb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:11.831914 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-39def11c-3502-42d6-881c-b0decd243cfb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:11.985980 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-39def11c-3502-42d6-881c-b0decd243cfb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:11.999272 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-39def11c-3502-42d6-881c-b0decd243cfb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:12.000822 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-39def11c-3502-42d6-881c-b0decd243cfb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:12.001971 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-39def11c-3502-42d6-881c-b0decd243cfb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.183487 Feb 08 17:29:12.002528 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 64/125] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:11 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:29:12.474789 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2e275cb0-bcd0-4569-b7dc-04aedadc0a1f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:12.476105 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2e275cb0-bcd0-4569-b7dc-04aedadc0a1f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:12.488489 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2e275cb0-bcd0-4569-b7dc-04aedadc0a1f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:12.491464 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2e275cb0-bcd0-4569-b7dc-04aedadc0a1f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:12.491464 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2e275cb0-bcd0-4569-b7dc-04aedadc0a1f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:12.492054 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2e275cb0-bcd0-4569-b7dc-04aedadc0a1f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:12.717150 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2e275cb0-bcd0-4569-b7dc-04aedadc0a1f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:12.732761 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2e275cb0-bcd0-4569-b7dc-04aedadc0a1f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.265489 Feb 08 17:29:12.733792 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 62/126] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:12 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:12.807075 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f4a1e9bf-921b-48d0-ace2-04cc47b6573b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:12.808081 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f4a1e9bf-921b-48d0-ace2-04cc47b6573b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:12.820191 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f4a1e9bf-921b-48d0-ace2-04cc47b6573b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:12.820651 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f4a1e9bf-921b-48d0-ace2-04cc47b6573b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:12.821844 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f4a1e9bf-921b-48d0-ace2-04cc47b6573b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:12.822347 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f4a1e9bf-921b-48d0-ace2-04cc47b6573b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:13.020337 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4335248a-074f-4e7b-bf72-6f4c8602199b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:13.021355 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4335248a-074f-4e7b-bf72-6f4c8602199b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:13.028549 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4335248a-074f-4e7b-bf72-6f4c8602199b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:13.029099 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4335248a-074f-4e7b-bf72-6f4c8602199b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:13.030231 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4335248a-074f-4e7b-bf72-6f4c8602199b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:13.030953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4335248a-074f-4e7b-bf72-6f4c8602199b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:13.056644 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f4a1e9bf-921b-48d0-ace2-04cc47b6573b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:13.070414 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f4a1e9bf-921b-48d0-ace2-04cc47b6573b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.270041 Feb 08 17:29:13.071001 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 65/127] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:12 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:13.236435 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4335248a-074f-4e7b-bf72-6f4c8602199b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:13.252757 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4335248a-074f-4e7b-bf72-6f4c8602199b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:13.255477 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4335248a-074f-4e7b-bf72-6f4c8602199b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:13.258474 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4335248a-074f-4e7b-bf72-6f4c8602199b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1407 microversion: 2.20 time: 0.241480 Feb 08 17:29:13.259595 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 63/128] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:13 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:29:13.762104 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0090858f-1b99-4b33-b193-65edd18d3525 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:13.763643 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0090858f-1b99-4b33-b193-65edd18d3525 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:13.774592 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0090858f-1b99-4b33-b193-65edd18d3525 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:13.787303 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0090858f-1b99-4b33-b193-65edd18d3525 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:13.794227 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0090858f-1b99-4b33-b193-65edd18d3525 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:13.795019 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0090858f-1b99-4b33-b193-65edd18d3525 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:14.043194 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0090858f-1b99-4b33-b193-65edd18d3525 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:14.054236 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0090858f-1b99-4b33-b193-65edd18d3525 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.297128 Feb 08 17:29:14.063924 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-b8f2d8eb-c41c-4030-9458-9c782d6b86df req-574a61f2-997d-43f4-996a-059565ecda3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8921a8f3-fa2c-43e4-90fa-a8a936c1eda0", "name": "network-vif-plugged", "status": "completed", "tag": "998b80e9-4624-47bb-91e8-25b96f1bc969"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:29:14.065649 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 66/129] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:13 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:14.068031 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:29:14.068031 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:29:14.081657 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-b8f2d8eb-c41c-4030-9458-9c782d6b86df req-574a61f2-997d-43f4-996a-059565ecda3c service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:14.082456 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-b8f2d8eb-c41c-4030-9458-9c782d6b86df req-574a61f2-997d-43f4-996a-059565ecda3c service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:14.097748 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2b3a226f-28d0-4f12-b77f-730097d12f68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:14.098932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2b3a226f-28d0-4f12-b77f-730097d12f68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:14.102774 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-b8f2d8eb-c41c-4030-9458-9c782d6b86df req-574a61f2-997d-43f4-996a-059565ecda3c service nova] Creating event network-vif-plugged:998b80e9-4624-47bb-91e8-25b96f1bc969 for instance 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 on hv-cinder-82204 Feb 08 17:29:14.108259 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2b3a226f-28d0-4f12-b77f-730097d12f68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:14.110178 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2b3a226f-28d0-4f12-b77f-730097d12f68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:14.111699 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2b3a226f-28d0-4f12-b77f-730097d12f68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:14.112743 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2b3a226f-28d0-4f12-b77f-730097d12f68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:14.116686 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-b8f2d8eb-c41c-4030-9458-9c782d6b86df req-574a61f2-997d-43f4-996a-059565ecda3c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059508 Feb 08 17:29:14.117956 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 64/130] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:14.283177 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1059b5a6-e819-43ef-a482-4cacf0d883b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:14.285006 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1059b5a6-e819-43ef-a482-4cacf0d883b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:14.297397 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1059b5a6-e819-43ef-a482-4cacf0d883b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:14.298426 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1059b5a6-e819-43ef-a482-4cacf0d883b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:14.300085 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1059b5a6-e819-43ef-a482-4cacf0d883b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:14.300952 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1059b5a6-e819-43ef-a482-4cacf0d883b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:14.383652 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2b3a226f-28d0-4f12-b77f-730097d12f68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:14.395008 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2b3a226f-28d0-4f12-b77f-730097d12f68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.301808 Feb 08 17:29:14.395971 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 67/131] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:14 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:14.466105 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1059b5a6-e819-43ef-a482-4cacf0d883b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:14.477992 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1059b5a6-e819-43ef-a482-4cacf0d883b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:14.479509 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1059b5a6-e819-43ef-a482-4cacf0d883b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:14.480756 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1059b5a6-e819-43ef-a482-4cacf0d883b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1600 microversion: 2.20 time: 0.205456 Feb 08 17:29:14.481262 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 65/132] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:14 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1600 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:29:14.502594 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8d2e7f15-124d-4b7c-b780-831fd155d6af tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:14.503091 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8d2e7f15-124d-4b7c-b780-831fd155d6af tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:14.512240 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d2e7f15-124d-4b7c-b780-831fd155d6af tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:14.512717 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d2e7f15-124d-4b7c-b780-831fd155d6af tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:14.513547 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d2e7f15-124d-4b7c-b780-831fd155d6af tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:14.513984 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d2e7f15-124d-4b7c-b780-831fd155d6af tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:14.654045 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8d2e7f15-124d-4b7c-b780-831fd155d6af tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.156244 Feb 08 17:29:14.654647 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 68/133] 10.222.0.69 () {60 vars in 1315 bytes} [Tue Feb 8 17:29:14 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 17:29:15.082019 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-80285495-f5dd-45ca-a464-5e5ebf59f5ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:15.084008 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-80285495-f5dd-45ca-a464-5e5ebf59f5ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:15.098013 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-80285495-f5dd-45ca-a464-5e5ebf59f5ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:15.098901 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-80285495-f5dd-45ca-a464-5e5ebf59f5ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:15.101247 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-80285495-f5dd-45ca-a464-5e5ebf59f5ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:15.102290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-80285495-f5dd-45ca-a464-5e5ebf59f5ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:15.417482 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5c27dbc9-03bc-4da7-9050-b48c5d84cf6a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:15.421347 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5c27dbc9-03bc-4da7-9050-b48c5d84cf6a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:15.430492 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5c27dbc9-03bc-4da7-9050-b48c5d84cf6a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:15.431622 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5c27dbc9-03bc-4da7-9050-b48c5d84cf6a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:15.432704 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5c27dbc9-03bc-4da7-9050-b48c5d84cf6a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:15.433416 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5c27dbc9-03bc-4da7-9050-b48c5d84cf6a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:15.664243 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5c27dbc9-03bc-4da7-9050-b48c5d84cf6a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:15.681446 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5c27dbc9-03bc-4da7-9050-b48c5d84cf6a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.265788 Feb 08 17:29:15.682439 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 69/134] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:15 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:16.078935 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-80285495-f5dd-45ca-a464-5e5ebf59f5ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:16.088681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-80285495-f5dd-45ca-a464-5e5ebf59f5ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 1.012212 Feb 08 17:29:16.091522 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 66/135] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:15 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:16.704695 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2dc3c44c-24fd-440a-a890-7748b12aad62 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:16.706660 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2dc3c44c-24fd-440a-a890-7748b12aad62 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:16.713704 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2dc3c44c-24fd-440a-a890-7748b12aad62 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:16.714158 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2dc3c44c-24fd-440a-a890-7748b12aad62 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:16.714955 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2dc3c44c-24fd-440a-a890-7748b12aad62 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:16.715388 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2dc3c44c-24fd-440a-a890-7748b12aad62 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:16.859065 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2fca4f8f-b43c-4674-9b43-e9d85c42ee34 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:16.860534 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2fca4f8f-b43c-4674-9b43-e9d85c42ee34 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:16.870996 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2fca4f8f-b43c-4674-9b43-e9d85c42ee34 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:16.875508 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2fca4f8f-b43c-4674-9b43-e9d85c42ee34 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:16.878846 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2fca4f8f-b43c-4674-9b43-e9d85c42ee34 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:16.880056 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2fca4f8f-b43c-4674-9b43-e9d85c42ee34 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:16.882349 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2dc3c44c-24fd-440a-a890-7748b12aad62 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:16.892130 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2dc3c44c-24fd-440a-a890-7748b12aad62 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.191575 Feb 08 17:29:16.893703 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 70/136] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:16 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:16.901023 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-be3ac640-3b02-4844-b8b1-4c145fd57e3b req-a7c744c9-2d7e-422f-8519-130cf794ade3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73f173b-bae7-44a2-b686-0179e64e9c30", "tag": "72759e6a-9d50-4192-90ea-3e1d17bb4b78"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:29:16.903181 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:29:16.903181 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:29:16.916584 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-be3ac640-3b02-4844-b8b1-4c145fd57e3b req-a7c744c9-2d7e-422f-8519-130cf794ade3 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:16.917551 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-be3ac640-3b02-4844-b8b1-4c145fd57e3b req-a7c744c9-2d7e-422f-8519-130cf794ade3 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:16.935942 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-be3ac640-3b02-4844-b8b1-4c145fd57e3b req-a7c744c9-2d7e-422f-8519-130cf794ade3 service nova] Creating event network-changed:72759e6a-9d50-4192-90ea-3e1d17bb4b78 for instance c73f173b-bae7-44a2-b686-0179e64e9c30 on hv-cinder-82204 Feb 08 17:29:16.956200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-be3ac640-3b02-4844-b8b1-4c145fd57e3b req-a7c744c9-2d7e-422f-8519-130cf794ade3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060950 Feb 08 17:29:16.957333 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 71/137] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:17.124320 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-51af1212-ea16-402b-be05-170ef1a3fafd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:17.125518 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-51af1212-ea16-402b-be05-170ef1a3fafd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:17.138603 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-51af1212-ea16-402b-be05-170ef1a3fafd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:17.139414 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-51af1212-ea16-402b-be05-170ef1a3fafd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:17.140367 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-51af1212-ea16-402b-be05-170ef1a3fafd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:17.140948 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-51af1212-ea16-402b-be05-170ef1a3fafd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:17.170405 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2fca4f8f-b43c-4674-9b43-e9d85c42ee34 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:17.189048 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2fca4f8f-b43c-4674-9b43-e9d85c42ee34 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:17.192090 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2fca4f8f-b43c-4674-9b43-e9d85c42ee34 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:17.195069 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2fca4f8f-b43c-4674-9b43-e9d85c42ee34 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1600 microversion: 2.20 time: 0.341479 Feb 08 17:29:17.196131 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 67/138] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:16 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1600 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:29:17.362955 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-51af1212-ea16-402b-be05-170ef1a3fafd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:17.384061 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-51af1212-ea16-402b-be05-170ef1a3fafd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.271549 Feb 08 17:29:17.385196 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 72/139] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:17 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:17.920889 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1785afa8-b7a8-4c34-ae5e-a8cbb4985d52 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:17.922249 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1785afa8-b7a8-4c34-ae5e-a8cbb4985d52 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:17.932346 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1785afa8-b7a8-4c34-ae5e-a8cbb4985d52 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:17.932948 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1785afa8-b7a8-4c34-ae5e-a8cbb4985d52 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:17.933868 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1785afa8-b7a8-4c34-ae5e-a8cbb4985d52 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:17.934396 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1785afa8-b7a8-4c34-ae5e-a8cbb4985d52 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:18.216768 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1785afa8-b7a8-4c34-ae5e-a8cbb4985d52 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:18.219544 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-961478c1-5621-4d3b-884d-af968b84ad5c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:18.220319 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-961478c1-5621-4d3b-884d-af968b84ad5c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:18.233615 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-961478c1-5621-4d3b-884d-af968b84ad5c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:18.234536 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-961478c1-5621-4d3b-884d-af968b84ad5c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:18.236617 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1785afa8-b7a8-4c34-ae5e-a8cbb4985d52 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.323195 Feb 08 17:29:18.238798 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 68/140] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:17 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:18.239200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-961478c1-5621-4d3b-884d-af968b84ad5c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:18.241575 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-961478c1-5621-4d3b-884d-af968b84ad5c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:18.413139 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a4786bb3-add9-445d-beac-ee17d93d126a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:18.414815 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a4786bb3-add9-445d-beac-ee17d93d126a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:18.437602 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4786bb3-add9-445d-beac-ee17d93d126a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:18.438441 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4786bb3-add9-445d-beac-ee17d93d126a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:18.439774 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4786bb3-add9-445d-beac-ee17d93d126a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:18.441257 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4786bb3-add9-445d-beac-ee17d93d126a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:18.528051 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-961478c1-5621-4d3b-884d-af968b84ad5c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:18.549822 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-961478c1-5621-4d3b-884d-af968b84ad5c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:18.554591 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-961478c1-5621-4d3b-884d-af968b84ad5c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:18.557455 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-961478c1-5621-4d3b-884d-af968b84ad5c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1600 microversion: 2.20 time: 0.341911 Feb 08 17:29:18.558799 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 73/141] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:18 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1600 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:29:18.904743 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a4786bb3-add9-445d-beac-ee17d93d126a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:18.948429 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a4786bb3-add9-445d-beac-ee17d93d126a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.546487 Feb 08 17:29:18.954707 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 69/142] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:18 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:19.270796 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-dca75f78-7b06-4248-baf5-0fa5ed36b76e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:19.272880 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-dca75f78-7b06-4248-baf5-0fa5ed36b76e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:19.293999 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dca75f78-7b06-4248-baf5-0fa5ed36b76e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:19.294792 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dca75f78-7b06-4248-baf5-0fa5ed36b76e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:19.302841 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dca75f78-7b06-4248-baf5-0fa5ed36b76e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:19.303674 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dca75f78-7b06-4248-baf5-0fa5ed36b76e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:19.570741 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-dca75f78-7b06-4248-baf5-0fa5ed36b76e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:19.584226 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-dca75f78-7b06-4248-baf5-0fa5ed36b76e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.325679 Feb 08 17:29:19.592012 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2b067cce-0696-49b7-8656-81991624257b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:19.592802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2b067cce-0696-49b7-8656-81991624257b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:19.600451 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b067cce-0696-49b7-8656-81991624257b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:19.600902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b067cce-0696-49b7-8656-81991624257b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:19.601795 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b067cce-0696-49b7-8656-81991624257b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:19.602437 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b067cce-0696-49b7-8656-81991624257b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:19.602582 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 74/143] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:19 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:19.866654 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2b067cce-0696-49b7-8656-81991624257b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:19.884253 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2b067cce-0696-49b7-8656-81991624257b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:19.886566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2b067cce-0696-49b7-8656-81991624257b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:19.888825 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2b067cce-0696-49b7-8656-81991624257b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1719 microversion: 2.20 time: 0.303894 Feb 08 17:29:19.890008 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 70/144] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:29:19 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1719 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:29:19.926699 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a1e7b8ff-2cfc-4ea7-8017-8712414668a7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:19.927981 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a1e7b8ff-2cfc-4ea7-8017-8712414668a7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:19.941230 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a1e7b8ff-2cfc-4ea7-8017-8712414668a7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:19.942332 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a1e7b8ff-2cfc-4ea7-8017-8712414668a7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:19.944169 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a1e7b8ff-2cfc-4ea7-8017-8712414668a7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:19.945205 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a1e7b8ff-2cfc-4ea7-8017-8712414668a7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:19.984895 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-24751f5b-bfdd-40d3-91b0-9e4a8dfe83bf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:19.985756 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-24751f5b-bfdd-40d3-91b0-9e4a8dfe83bf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:19.995557 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a1e7b8ff-2cfc-4ea7-8017-8712414668a7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/ips" status: 200 len: 153 microversion: 2.20 time: 0.078613 Feb 08 17:29:19.999427 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24751f5b-bfdd-40d3-91b0-9e4a8dfe83bf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:20.000510 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24751f5b-bfdd-40d3-91b0-9e4a8dfe83bf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:20.001686 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 75/145] 10.222.0.69 () {60 vars in 1288 bytes} [Tue Feb 8 17:29:19 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/ips => generated 153 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 17:29:20.002895 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24751f5b-bfdd-40d3-91b0-9e4a8dfe83bf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:20.004201 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24751f5b-bfdd-40d3-91b0-9e4a8dfe83bf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:20.342996 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-24751f5b-bfdd-40d3-91b0-9e4a8dfe83bf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:20.367779 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-24751f5b-bfdd-40d3-91b0-9e4a8dfe83bf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1363 microversion: 2.1 time: 0.387327 Feb 08 17:29:20.375264 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 71/146] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:19 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1363 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:20.611391 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f121cb6a-b3a6-402d-86c0-10332bd93f29 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:20.612182 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f121cb6a-b3a6-402d-86c0-10332bd93f29 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:20.629506 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f121cb6a-b3a6-402d-86c0-10332bd93f29 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:20.630302 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f121cb6a-b3a6-402d-86c0-10332bd93f29 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:20.636095 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f121cb6a-b3a6-402d-86c0-10332bd93f29 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:20.637026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f121cb6a-b3a6-402d-86c0-10332bd93f29 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:20.978045 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f121cb6a-b3a6-402d-86c0-10332bd93f29 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:21.000050 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f121cb6a-b3a6-402d-86c0-10332bd93f29 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.393629 Feb 08 17:29:21.001554 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 76/147] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:20 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:21.395692 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e3666cce-91a4-459d-a08e-db45b25a90df tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:21.396560 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e3666cce-91a4-459d-a08e-db45b25a90df tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:21.403119 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e3666cce-91a4-459d-a08e-db45b25a90df tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:21.403608 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e3666cce-91a4-459d-a08e-db45b25a90df tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:21.404502 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e3666cce-91a4-459d-a08e-db45b25a90df tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:21.405079 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e3666cce-91a4-459d-a08e-db45b25a90df tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:21.795708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e3666cce-91a4-459d-a08e-db45b25a90df tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:21.822916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e3666cce-91a4-459d-a08e-db45b25a90df tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1548 microversion: 2.1 time: 0.433947 Feb 08 17:29:21.824301 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 72/148] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:21 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1548 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:21.856204 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cab0e119-e722-4c23-a275-c05046ccd268 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:21.858142 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-cab0e119-e722-4c23-a275-c05046ccd268 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:21.873665 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cab0e119-e722-4c23-a275-c05046ccd268 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:21.881198 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cab0e119-e722-4c23-a275-c05046ccd268 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:21.883504 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cab0e119-e722-4c23-a275-c05046ccd268 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:21.888034 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cab0e119-e722-4c23-a275-c05046ccd268 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:22.031503 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-59dedc2c-130b-45c5-a63f-af39700f8802 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:22.032583 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-59dedc2c-130b-45c5-a63f-af39700f8802 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:22.040758 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-59dedc2c-130b-45c5-a63f-af39700f8802 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:22.041664 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-59dedc2c-130b-45c5-a63f-af39700f8802 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:22.042886 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-59dedc2c-130b-45c5-a63f-af39700f8802 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:22.043669 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-59dedc2c-130b-45c5-a63f-af39700f8802 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:22.302563 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cab0e119-e722-4c23-a275-c05046ccd268 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.453109 Feb 08 17:29:22.304557 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 77/149] 10.222.0.69 () {58 vars in 1274 bytes} [Tue Feb 8 17:29:21 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/os-interface => generated 284 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:22.389526 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6beae953-b38f-4cd0-bdf7-7b6df7d086c3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:22.390561 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6beae953-b38f-4cd0-bdf7-7b6df7d086c3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:22.415374 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6beae953-b38f-4cd0-bdf7-7b6df7d086c3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:22.416496 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6beae953-b38f-4cd0-bdf7-7b6df7d086c3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:22.424333 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6beae953-b38f-4cd0-bdf7-7b6df7d086c3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:22.445524 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6beae953-b38f-4cd0-bdf7-7b6df7d086c3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:22.447139 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-59dedc2c-130b-45c5-a63f-af39700f8802 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:22.465573 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-59dedc2c-130b-45c5-a63f-af39700f8802 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.439444 Feb 08 17:29:22.468374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 73/150] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:22 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:22.511730 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6beae953-b38f-4cd0-bdf7-7b6df7d086c3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Going to try to terminate instance {{(pid=116479) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:29:22.773218 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6beae953-b38f-4cd0-bdf7-7b6df7d086c3 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 204 len: 0 microversion: 2.1 time: 0.389887 Feb 08 17:29:22.774969 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 78/151] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:29:22 2022] DELETE /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:29:22.786386 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-da39a6f8-bb84-411b-86fc-a332c3ce2228 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:22.787462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-da39a6f8-bb84-411b-86fc-a332c3ce2228 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:22.800109 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-da39a6f8-bb84-411b-86fc-a332c3ce2228 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:22.801360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-da39a6f8-bb84-411b-86fc-a332c3ce2228 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:22.804374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-da39a6f8-bb84-411b-86fc-a332c3ce2228 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:22.805092 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-da39a6f8-bb84-411b-86fc-a332c3ce2228 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:23.070487 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-da39a6f8-bb84-411b-86fc-a332c3ce2228 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:23.093883 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-da39a6f8-bb84-411b-86fc-a332c3ce2228 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1554 microversion: 2.1 time: 0.313193 Feb 08 17:29:23.095455 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 74/152] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:22 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1554 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:23.489293 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ee93923e-1bfd-4b84-a98b-777a75d336c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:23.490390 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ee93923e-1bfd-4b84-a98b-777a75d336c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:23.524633 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ee93923e-1bfd-4b84-a98b-777a75d336c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:23.525505 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ee93923e-1bfd-4b84-a98b-777a75d336c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:23.526639 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ee93923e-1bfd-4b84-a98b-777a75d336c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:23.527453 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ee93923e-1bfd-4b84-a98b-777a75d336c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:24.125522 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-57d29ec4-0c03-454b-a009-b03614c9a2f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:24.126640 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-57d29ec4-0c03-454b-a009-b03614c9a2f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:24.150781 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-57d29ec4-0c03-454b-a009-b03614c9a2f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:24.152268 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-57d29ec4-0c03-454b-a009-b03614c9a2f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:24.155225 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-57d29ec4-0c03-454b-a009-b03614c9a2f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:24.156438 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-57d29ec4-0c03-454b-a009-b03614c9a2f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:24.225577 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ee93923e-1bfd-4b84-a98b-777a75d336c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:24.252812 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ee93923e-1bfd-4b84-a98b-777a75d336c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.767411 Feb 08 17:29:24.259905 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 79/153] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:23 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:24.527208 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-57d29ec4-0c03-454b-a009-b03614c9a2f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:24.557887 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-57d29ec4-0c03-454b-a009-b03614c9a2f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1554 microversion: 2.1 time: 0.436521 Feb 08 17:29:24.561714 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 75/154] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:24 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1554 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:24.940876 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-abf3feb2-7ad0-433d-b25c-83da7654ca93 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:24.942133 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-abf3feb2-7ad0-433d-b25c-83da7654ca93 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:24.947548 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-0501cd73-ee06-47a9-8a18-36793d1bc4d1 req-172c3f15-c8f2-4a23-8795-1e3d98ba9711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8921a8f3-fa2c-43e4-90fa-a8a936c1eda0", "tag": "998b80e9-4624-47bb-91e8-25b96f1bc969"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:29:24.949271 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:29:24.949271 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:29:24.963462 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-abf3feb2-7ad0-433d-b25c-83da7654ca93 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:24.965864 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-0501cd73-ee06-47a9-8a18-36793d1bc4d1 req-172c3f15-c8f2-4a23-8795-1e3d98ba9711 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:24.966627 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-0501cd73-ee06-47a9-8a18-36793d1bc4d1 req-172c3f15-c8f2-4a23-8795-1e3d98ba9711 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:24.967531 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-abf3feb2-7ad0-433d-b25c-83da7654ca93 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:24.969186 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-abf3feb2-7ad0-433d-b25c-83da7654ca93 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:24.972401 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-abf3feb2-7ad0-433d-b25c-83da7654ca93 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:25.017473 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-0501cd73-ee06-47a9-8a18-36793d1bc4d1 req-172c3f15-c8f2-4a23-8795-1e3d98ba9711 service nova] Creating event network-changed:998b80e9-4624-47bb-91e8-25b96f1bc969 for instance 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 on hv-cinder-82204 Feb 08 17:29:25.037689 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-0501cd73-ee06-47a9-8a18-36793d1bc4d1 req-172c3f15-c8f2-4a23-8795-1e3d98ba9711 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090163 Feb 08 17:29:25.038738 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 76/155] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:25.284071 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-abf3feb2-7ad0-433d-b25c-83da7654ca93 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:25.284902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-687431bc-343e-4b08-ab1d-bd461ea247bc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:25.285717 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-687431bc-343e-4b08-ab1d-bd461ea247bc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:25.299597 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-abf3feb2-7ad0-433d-b25c-83da7654ca93 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1548 microversion: 2.1 time: 0.362516 Feb 08 17:29:25.306327 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-687431bc-343e-4b08-ab1d-bd461ea247bc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:25.307028 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-687431bc-343e-4b08-ab1d-bd461ea247bc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:25.308026 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-687431bc-343e-4b08-ab1d-bd461ea247bc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:25.308621 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-687431bc-343e-4b08-ab1d-bd461ea247bc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:25.319551 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 80/156] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:24 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1548 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:25.596345 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8d4b806e-0104-4903-98cb-19a2c2ce3437 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:25.600870 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8d4b806e-0104-4903-98cb-19a2c2ce3437 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:25.650241 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-687431bc-343e-4b08-ab1d-bd461ea247bc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:25.655683 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d4b806e-0104-4903-98cb-19a2c2ce3437 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:25.656512 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d4b806e-0104-4903-98cb-19a2c2ce3437 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:25.659514 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d4b806e-0104-4903-98cb-19a2c2ce3437 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:25.666516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d4b806e-0104-4903-98cb-19a2c2ce3437 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:25.673397 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-687431bc-343e-4b08-ab1d-bd461ea247bc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.393337 Feb 08 17:29:25.695851 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 77/157] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:25 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:26.056497 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8d4b806e-0104-4903-98cb-19a2c2ce3437 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:26.072637 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8d4b806e-0104-4903-98cb-19a2c2ce3437 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1554 microversion: 2.1 time: 0.489076 Feb 08 17:29:26.073275 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 81/158] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:25 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1554 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:26.328698 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d991ff33-6873-411f-bbcb-629cc1a6ccea tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:26.330217 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d991ff33-6873-411f-bbcb-629cc1a6ccea tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:26.350767 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d991ff33-6873-411f-bbcb-629cc1a6ccea tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:26.351486 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d991ff33-6873-411f-bbcb-629cc1a6ccea tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:26.362143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d991ff33-6873-411f-bbcb-629cc1a6ccea tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:26.362143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d991ff33-6873-411f-bbcb-629cc1a6ccea tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:26.575224 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d991ff33-6873-411f-bbcb-629cc1a6ccea tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:26.588708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d991ff33-6873-411f-bbcb-629cc1a6ccea tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1548 microversion: 2.1 time: 0.266372 Feb 08 17:29:26.590440 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 78/159] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:26 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1548 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:26.700487 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4eae927b-6f0a-4013-964a-545a71f8e891 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:26.701272 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4eae927b-6f0a-4013-964a-545a71f8e891 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:26.712316 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4eae927b-6f0a-4013-964a-545a71f8e891 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:26.713471 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4eae927b-6f0a-4013-964a-545a71f8e891 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:26.714895 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4eae927b-6f0a-4013-964a-545a71f8e891 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:26.716056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4eae927b-6f0a-4013-964a-545a71f8e891 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:26.941386 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4eae927b-6f0a-4013-964a-545a71f8e891 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:26.952712 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4eae927b-6f0a-4013-964a-545a71f8e891 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.255476 Feb 08 17:29:26.955323 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 82/160] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:26 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:27.105056 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-77114907-243a-4150-a705-2880a0f63579 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:27.107158 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-77114907-243a-4150-a705-2880a0f63579 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:27.117838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-77114907-243a-4150-a705-2880a0f63579 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:27.118515 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-77114907-243a-4150-a705-2880a0f63579 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:27.119734 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-77114907-243a-4150-a705-2880a0f63579 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:27.120398 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-77114907-243a-4150-a705-2880a0f63579 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:27.408699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-77114907-243a-4150-a705-2880a0f63579 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:27.417041 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-77114907-243a-4150-a705-2880a0f63579 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1554 microversion: 2.1 time: 0.318896 Feb 08 17:29:27.417888 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 79/161] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:27 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1554 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:27.613047 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d96cb8cd-f455-484f-97a5-98e2a865af83 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:27.614547 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d96cb8cd-f455-484f-97a5-98e2a865af83 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:27.624707 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d96cb8cd-f455-484f-97a5-98e2a865af83 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:27.625471 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d96cb8cd-f455-484f-97a5-98e2a865af83 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:27.626789 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d96cb8cd-f455-484f-97a5-98e2a865af83 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:27.627498 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d96cb8cd-f455-484f-97a5-98e2a865af83 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:27.818649 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d96cb8cd-f455-484f-97a5-98e2a865af83 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:27.828923 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d96cb8cd-f455-484f-97a5-98e2a865af83 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1548 microversion: 2.1 time: 0.222446 Feb 08 17:29:27.829571 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 83/162] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:27 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1548 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:27.978283 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0e11c965-62a9-47b0-80e4-b3a67fd6ebab tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:27.979200 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0e11c965-62a9-47b0-80e4-b3a67fd6ebab tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:27.985654 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0e11c965-62a9-47b0-80e4-b3a67fd6ebab tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:27.986076 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0e11c965-62a9-47b0-80e4-b3a67fd6ebab tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:27.986878 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0e11c965-62a9-47b0-80e4-b3a67fd6ebab tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:27.987794 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0e11c965-62a9-47b0-80e4-b3a67fd6ebab tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:28.147984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0e11c965-62a9-47b0-80e4-b3a67fd6ebab tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:28.156366 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0e11c965-62a9-47b0-80e4-b3a67fd6ebab tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.184287 Feb 08 17:29:28.156945 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 80/163] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:27 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:28.439380 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f05e1268-14d6-4b3c-96da-0b09f46f4203 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:28.440442 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f05e1268-14d6-4b3c-96da-0b09f46f4203 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:28.468228 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f05e1268-14d6-4b3c-96da-0b09f46f4203 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:28.468892 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f05e1268-14d6-4b3c-96da-0b09f46f4203 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:28.470849 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f05e1268-14d6-4b3c-96da-0b09f46f4203 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:28.471718 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f05e1268-14d6-4b3c-96da-0b09f46f4203 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:28.718342 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f05e1268-14d6-4b3c-96da-0b09f46f4203 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:28.742782 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f05e1268-14d6-4b3c-96da-0b09f46f4203 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1554 microversion: 2.1 time: 0.310481 Feb 08 17:29:28.757471 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 84/164] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:28 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1554 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:28.852502 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e60cabed-ca6f-434b-9913-b01db358353b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:28.855080 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e60cabed-ca6f-434b-9913-b01db358353b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:28.864887 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e60cabed-ca6f-434b-9913-b01db358353b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:28.865530 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e60cabed-ca6f-434b-9913-b01db358353b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:28.866825 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e60cabed-ca6f-434b-9913-b01db358353b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:28.867292 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e60cabed-ca6f-434b-9913-b01db358353b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:29.185342 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-905350e3-f048-48cc-8604-0ca177f9c90c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:29.188146 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-905350e3-f048-48cc-8604-0ca177f9c90c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:29.194817 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-905350e3-f048-48cc-8604-0ca177f9c90c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:29.195583 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-905350e3-f048-48cc-8604-0ca177f9c90c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:29.196827 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-905350e3-f048-48cc-8604-0ca177f9c90c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:29.200029 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-905350e3-f048-48cc-8604-0ca177f9c90c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:29.399886 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e60cabed-ca6f-434b-9913-b01db358353b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:29.413788 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e60cabed-ca6f-434b-9913-b01db358353b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1548 microversion: 2.1 time: 0.568282 Feb 08 17:29:29.417946 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 81/165] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:28 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1548 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:29.655701 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-905350e3-f048-48cc-8604-0ca177f9c90c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:29.668043 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-905350e3-f048-48cc-8604-0ca177f9c90c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.494109 Feb 08 17:29:29.669062 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 85/166] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:29 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:29.772668 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a6f8a114-80a7-4611-bcd5-02e014412407 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:29.773681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a6f8a114-80a7-4611-bcd5-02e014412407 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:29.810133 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a6f8a114-80a7-4611-bcd5-02e014412407 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:29.810699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a6f8a114-80a7-4611-bcd5-02e014412407 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:29.811390 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a6f8a114-80a7-4611-bcd5-02e014412407 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:29.811851 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a6f8a114-80a7-4611-bcd5-02e014412407 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:30.125409 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a6f8a114-80a7-4611-bcd5-02e014412407 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:30.143648 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a6f8a114-80a7-4611-bcd5-02e014412407 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1554 microversion: 2.1 time: 0.377527 Feb 08 17:29:30.144950 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 82/167] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:29 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1554 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:30.338278 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-645eeea6-70d1-4fc6-a393-76bec0af65ad req-3e47dd01-242e-49c4-b26b-d448357c7bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c13b043-55ff-4372-99f9-1e4453cf6d65", "name": "network-vif-deleted", "tag": "8d8d9a21-bb56-4e6b-b9fb-bdcf1e8ca8c2"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:29:30.339893 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:29:30.339893 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:29:30.348429 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-645eeea6-70d1-4fc6-a393-76bec0af65ad req-3e47dd01-242e-49c4-b26b-d448357c7bb2 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:30.348994 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-645eeea6-70d1-4fc6-a393-76bec0af65ad req-3e47dd01-242e-49c4-b26b-d448357c7bb2 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:30.365255 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-645eeea6-70d1-4fc6-a393-76bec0af65ad req-3e47dd01-242e-49c4-b26b-d448357c7bb2 service nova] Creating event network-vif-deleted:8d8d9a21-bb56-4e6b-b9fb-bdcf1e8ca8c2 for instance 2c13b043-55ff-4372-99f9-1e4453cf6d65 on hv-cinder-82204 Feb 08 17:29:30.379184 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-645eeea6-70d1-4fc6-a393-76bec0af65ad req-3e47dd01-242e-49c4-b26b-d448357c7bb2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043741 Feb 08 17:29:30.382240 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 86/168] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:29:30.443059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-07bb4e00-c0a4-4797-8bd6-e6a67e6f99bb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:30.444628 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-07bb4e00-c0a4-4797-8bd6-e6a67e6f99bb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:30.453067 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-07bb4e00-c0a4-4797-8bd6-e6a67e6f99bb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:30.453664 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-07bb4e00-c0a4-4797-8bd6-e6a67e6f99bb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:30.454558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-07bb4e00-c0a4-4797-8bd6-e6a67e6f99bb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:30.455097 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-07bb4e00-c0a4-4797-8bd6-e6a67e6f99bb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:30.637871 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-07bb4e00-c0a4-4797-8bd6-e6a67e6f99bb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:30.646059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-07bb4e00-c0a4-4797-8bd6-e6a67e6f99bb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1666 microversion: 2.1 time: 0.209601 Feb 08 17:29:30.646756 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 83/169] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:30 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1666 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:30.671166 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a58ca5df-c637-49a9-8d1b-fc5557d9669a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:30.672677 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a58ca5df-c637-49a9-8d1b-fc5557d9669a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:30.681702 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a58ca5df-c637-49a9-8d1b-fc5557d9669a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:30.682165 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a58ca5df-c637-49a9-8d1b-fc5557d9669a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:30.683077 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a58ca5df-c637-49a9-8d1b-fc5557d9669a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:30.683515 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a58ca5df-c637-49a9-8d1b-fc5557d9669a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:30.691913 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0d92093b-022c-4373-abb0-03830baa70f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:30.693374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0d92093b-022c-4373-abb0-03830baa70f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:30.709398 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d92093b-022c-4373-abb0-03830baa70f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:30.710817 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d92093b-022c-4373-abb0-03830baa70f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:30.712775 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d92093b-022c-4373-abb0-03830baa70f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:30.713826 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d92093b-022c-4373-abb0-03830baa70f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:30.715580 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a58ca5df-c637-49a9-8d1b-fc5557d9669a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/ips" status: 200 len: 144 microversion: 2.1 time: 0.054623 Feb 08 17:29:30.717963 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 87/170] 10.222.0.69 () {58 vars in 1247 bytes} [Tue Feb 8 17:29:30 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/ips => generated 144 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:30.963697 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0d92093b-022c-4373-abb0-03830baa70f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:30.971535 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0d92093b-022c-4373-abb0-03830baa70f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.289550 Feb 08 17:29:30.972821 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 84/171] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:30 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:31.167256 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1db3ef56-4440-4412-9420-bac9bdb51b15 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:31.168268 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1db3ef56-4440-4412-9420-bac9bdb51b15 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:31.182382 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1db3ef56-4440-4412-9420-bac9bdb51b15 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:31.182836 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1db3ef56-4440-4412-9420-bac9bdb51b15 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:31.183708 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1db3ef56-4440-4412-9420-bac9bdb51b15 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:31.184056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1db3ef56-4440-4412-9420-bac9bdb51b15 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:31.255728 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1db3ef56-4440-4412-9420-bac9bdb51b15 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:31.256532 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1db3ef56-4440-4412-9420-bac9bdb51b15 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:31.257374 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-1db3ef56-4440-4412-9420-bac9bdb51b15 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lazy-loading 'fault' on Instance uuid 2c13b043-55ff-4372-99f9-1e4453cf6d65 {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:29:31.340126 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1db3ef56-4440-4412-9420-bac9bdb51b15 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed158308978e420ab1367f83fda6ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fd043b62c54551965455405fd189e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:31.356951 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1db3ef56-4440-4412-9420-bac9bdb51b15 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 200 len: 1350 microversion: 2.1 time: 0.197368 Feb 08 17:29:31.358345 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 88/172] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:31 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 1350 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:32.002259 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-374fbaa9-fb61-4bab-b052-9c79a77a2198 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:32.004061 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-374fbaa9-fb61-4bab-b052-9c79a77a2198 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:32.019636 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-374fbaa9-fb61-4bab-b052-9c79a77a2198 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:32.020830 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-374fbaa9-fb61-4bab-b052-9c79a77a2198 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:32.023843 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-374fbaa9-fb61-4bab-b052-9c79a77a2198 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:32.025709 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-374fbaa9-fb61-4bab-b052-9c79a77a2198 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:32.275568 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-374fbaa9-fb61-4bab-b052-9c79a77a2198 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:32.285424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-374fbaa9-fb61-4bab-b052-9c79a77a2198 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.289080 Feb 08 17:29:32.290666 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 85/173] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:31 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:32.376057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bfff82d1-7ef7-4039-9dac-e2f6b83884f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:32.377088 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-bfff82d1-7ef7-4039-9dac-e2f6b83884f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:32.383335 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bfff82d1-7ef7-4039-9dac-e2f6b83884f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:32.384002 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bfff82d1-7ef7-4039-9dac-e2f6b83884f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:32.384960 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bfff82d1-7ef7-4039-9dac-e2f6b83884f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:32.385430 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bfff82d1-7ef7-4039-9dac-e2f6b83884f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:32.409535 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-bfff82d1-7ef7-4039-9dac-e2f6b83884f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] HTTP exception thrown: Instance 2c13b043-55ff-4372-99f9-1e4453cf6d65 could not be found. Feb 08 17:29:32.410639 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bfff82d1-7ef7-4039-9dac-e2f6b83884f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Returning 404 to user: Instance 2c13b043-55ff-4372-99f9-1e4453cf6d65 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:29:32.412251 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bfff82d1-7ef7-4039-9dac-e2f6b83884f8 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 404 len: 111 microversion: 2.1 time: 0.039729 Feb 08 17:29:32.413612 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 89/174] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:32 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 17:29:32.575031 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6a16d742-acba-4788-bc50-5ca8317270ab tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:32.576237 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6a16d742-acba-4788-bc50-5ca8317270ab tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:32.601254 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6a16d742-acba-4788-bc50-5ca8317270ab tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:32.601709 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6a16d742-acba-4788-bc50-5ca8317270ab tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:32.602651 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6a16d742-acba-4788-bc50-5ca8317270ab tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:32.603181 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6a16d742-acba-4788-bc50-5ca8317270ab tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:32.618731 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-6a16d742-acba-4788-bc50-5ca8317270ab tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] HTTP exception thrown: Instance 2c13b043-55ff-4372-99f9-1e4453cf6d65 could not be found. Feb 08 17:29:32.619433 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6a16d742-acba-4788-bc50-5ca8317270ab tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Returning 404 to user: Instance 2c13b043-55ff-4372-99f9-1e4453cf6d65 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:29:32.620251 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6a16d742-acba-4788-bc50-5ca8317270ab tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.062701 Feb 08 17:29:32.620814 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 86/175] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:29:32 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 17:29:33.322706 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f4e11889-3e3b-4a1e-8fe5-67b8733cac1b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:33.323600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f4e11889-3e3b-4a1e-8fe5-67b8733cac1b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:33.330464 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f4e11889-3e3b-4a1e-8fe5-67b8733cac1b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:33.331381 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f4e11889-3e3b-4a1e-8fe5-67b8733cac1b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:33.332347 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f4e11889-3e3b-4a1e-8fe5-67b8733cac1b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:33.332996 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f4e11889-3e3b-4a1e-8fe5-67b8733cac1b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:33.585376 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f4e11889-3e3b-4a1e-8fe5-67b8733cac1b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:33.608481 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f4e11889-3e3b-4a1e-8fe5-67b8733cac1b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.289391 Feb 08 17:29:33.626691 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 90/176] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:33 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:34.003037 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e50cc2d7-2210-4394-9886-ecd5792e8532 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:34.003571 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e50cc2d7-2210-4394-9886-ecd5792e8532 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:34.010493 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e50cc2d7-2210-4394-9886-ecd5792e8532 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:34.011174 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e50cc2d7-2210-4394-9886-ecd5792e8532 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:34.012051 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e50cc2d7-2210-4394-9886-ecd5792e8532 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:34.012486 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e50cc2d7-2210-4394-9886-ecd5792e8532 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:34.041066 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-e50cc2d7-2210-4394-9886-ecd5792e8532 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] HTTP exception thrown: Instance 2c13b043-55ff-4372-99f9-1e4453cf6d65 could not be found. Feb 08 17:29:34.042023 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e50cc2d7-2210-4394-9886-ecd5792e8532 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Returning 404 to user: Instance 2c13b043-55ff-4372-99f9-1e4453cf6d65 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:29:34.043438 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e50cc2d7-2210-4394-9886-ecd5792e8532 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 404 len: 111 microversion: 2.1 time: 0.044790 Feb 08 17:29:34.045331 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 87/177] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:29:33 2022] DELETE /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:29:34.056891 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8cb539fd-8274-4336-9249-22197b194972 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:34.058027 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8cb539fd-8274-4336-9249-22197b194972 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] [instance: 2c13b043-55ff-4372-99f9-1e4453cf6d65] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:34.074291 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8cb539fd-8274-4336-9249-22197b194972 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:34.074743 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8cb539fd-8274-4336-9249-22197b194972 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:34.077218 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8cb539fd-8274-4336-9249-22197b194972 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:34.077777 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8cb539fd-8274-4336-9249-22197b194972 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:34.100866 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-8cb539fd-8274-4336-9249-22197b194972 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] HTTP exception thrown: Instance 2c13b043-55ff-4372-99f9-1e4453cf6d65 could not be found. Feb 08 17:29:34.101803 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8cb539fd-8274-4336-9249-22197b194972 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] Returning 404 to user: Instance 2c13b043-55ff-4372-99f9-1e4453cf6d65 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:29:34.103005 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8cb539fd-8274-4336-9249-22197b194972 tempest-DeleteServersTestJSON-2011696548 tempest-DeleteServersTestJSON-2011696548-project] 10.222.0.69 "GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65" status: 404 len: 111 microversion: 2.1 time: 0.053321 Feb 08 17:29:34.104447 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 91/178] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:34 2022] GET /compute/v2.1/servers/2c13b043-55ff-4372-99f9-1e4453cf6d65 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:29:34.640715 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f36da324-7e1a-4409-8932-0e5aa144febf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:34.642448 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f36da324-7e1a-4409-8932-0e5aa144febf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:34.666244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f36da324-7e1a-4409-8932-0e5aa144febf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:34.671311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f36da324-7e1a-4409-8932-0e5aa144febf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:34.676002 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f36da324-7e1a-4409-8932-0e5aa144febf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:34.677353 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f36da324-7e1a-4409-8932-0e5aa144febf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:34.973881 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f36da324-7e1a-4409-8932-0e5aa144febf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:34.983602 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f36da324-7e1a-4409-8932-0e5aa144febf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.353144 Feb 08 17:29:34.984960 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 88/179] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:34 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:36.014326 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-10cb1db1-384a-4a9a-a4e7-a4d937d23eb5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:36.015904 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-10cb1db1-384a-4a9a-a4e7-a4d937d23eb5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:36.032921 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-10cb1db1-384a-4a9a-a4e7-a4d937d23eb5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:36.033409 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-10cb1db1-384a-4a9a-a4e7-a4d937d23eb5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:36.039547 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-10cb1db1-384a-4a9a-a4e7-a4d937d23eb5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:36.050122 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-10cb1db1-384a-4a9a-a4e7-a4d937d23eb5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:36.332944 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-10cb1db1-384a-4a9a-a4e7-a4d937d23eb5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:36.348052 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-10cb1db1-384a-4a9a-a4e7-a4d937d23eb5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.338681 Feb 08 17:29:36.349577 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 92/180] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:36 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:37.380514 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-aa049c83-b44e-4f21-85f7-4e1a5c7131fe tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:37.383567 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-aa049c83-b44e-4f21-85f7-4e1a5c7131fe tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:37.400221 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa049c83-b44e-4f21-85f7-4e1a5c7131fe tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:37.401523 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa049c83-b44e-4f21-85f7-4e1a5c7131fe tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:37.403389 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa049c83-b44e-4f21-85f7-4e1a5c7131fe tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:37.404638 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa049c83-b44e-4f21-85f7-4e1a5c7131fe tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:37.798553 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-aa049c83-b44e-4f21-85f7-4e1a5c7131fe tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:37.817772 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-aa049c83-b44e-4f21-85f7-4e1a5c7131fe tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.446697 Feb 08 17:29:37.830519 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 89/181] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:37 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:38.839365 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-64422a01-a7d7-4ddd-b027-47f1400cfff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:38.841776 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-64422a01-a7d7-4ddd-b027-47f1400cfff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:38.854686 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-64422a01-a7d7-4ddd-b027-47f1400cfff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:38.855786 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-64422a01-a7d7-4ddd-b027-47f1400cfff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:38.857392 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-64422a01-a7d7-4ddd-b027-47f1400cfff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:38.858953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-64422a01-a7d7-4ddd-b027-47f1400cfff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:39.160567 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e599deed-ab79-455f-be5c-a313b8a7668a tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Action: 'create', calling method: .version_select at 0x7fd9f9c6dc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1055778234", "metadata": {"Type": "work"}}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:29:39.190062 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-64422a01-a7d7-4ddd-b027-47f1400cfff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:39.206285 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-64422a01-a7d7-4ddd-b027-47f1400cfff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.370714 Feb 08 17:29:39.207595 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 90/182] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:38 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:39.825012 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e599deed-ab79-455f-be5c-a313b8a7668a tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.146339 Feb 08 17:29:39.826689 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 93/183] 10.222.0.69 () {60 vars in 1155 bytes} [Tue Feb 8 17:29:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1150 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 08 17:29:39.847746 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ef024aaf-05ff-4e5a-bd46-bcfcc741564f tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Calling method '.version_select at 0x7fd9fa34b700>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:40.060223 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ef024aaf-05ff-4e5a-bd46-bcfcc741564f tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee" status: 200 len: 353 microversion: 2.1 time: 0.218139 Feb 08 17:29:40.068462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 91/184] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:29:39 2022] GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee => generated 353 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:40.228114 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-fc7286e0-2be7-4af8-bef0-d09da1019faf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:40.229400 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-fc7286e0-2be7-4af8-bef0-d09da1019faf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:40.236514 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc7286e0-2be7-4af8-bef0-d09da1019faf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:40.237042 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc7286e0-2be7-4af8-bef0-d09da1019faf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:40.237932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc7286e0-2be7-4af8-bef0-d09da1019faf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:40.238557 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc7286e0-2be7-4af8-bef0-d09da1019faf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:40.454627 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-fc7286e0-2be7-4af8-bef0-d09da1019faf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:40.474492 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-fc7286e0-2be7-4af8-bef0-d09da1019faf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.247536 Feb 08 17:29:40.474492 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 94/185] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:40 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:41.078327 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0408481f-2f6a-43f0-84a4-f09bb0d5a3c5 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Calling method '.version_select at 0x7fd9fa34cdc0>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:41.164758 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0408481f-2f6a-43f0-84a4-f09bb0d5a3c5 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee" status: 200 len: 353 microversion: 2.1 time: 0.091783 Feb 08 17:29:41.168083 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 92/186] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:29:41 2022] GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:41.501734 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5332c331-5692-4b1f-9465-a037ab50283b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:41.504302 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5332c331-5692-4b1f-9465-a037ab50283b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:41.514145 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5332c331-5692-4b1f-9465-a037ab50283b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:41.515682 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5332c331-5692-4b1f-9465-a037ab50283b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:41.517768 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5332c331-5692-4b1f-9465-a037ab50283b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:41.518829 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5332c331-5692-4b1f-9465-a037ab50283b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:41.932578 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5332c331-5692-4b1f-9465-a037ab50283b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:41.959557 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5332c331-5692-4b1f-9465-a037ab50283b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.464749 Feb 08 17:29:41.962025 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 95/187] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:41 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:42.187329 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b22358da-6b7d-46ba-ab1b-721952b4eaa6 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Calling method '.version_select at 0x7fd9fa36bf70>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:42.317063 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b22358da-6b7d-46ba-ab1b-721952b4eaa6 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee" status: 200 len: 354 microversion: 2.1 time: 0.137368 Feb 08 17:29:42.329929 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 93/188] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:29:42 2022] GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:42.338990 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e33eaa70-f4a0-4a9f-97e1-cb90265c9788 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Calling method '.version_select at 0x7fd9f9c6dc10>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:42.430015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e33eaa70-f4a0-4a9f-97e1-cb90265c9788 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee" status: 200 len: 354 microversion: 2.1 time: 0.095669 Feb 08 17:29:42.431228 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 96/189] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:29:42 2022] GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:42.454818 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8e65e926-4d2d-4cd8-8500-dbf64624cf4a tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Calling method '.version_select at 0x7fd9fac62e50>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:42.575650 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8e65e926-4d2d-4cd8-8500-dbf64624cf4a tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee" status: 202 len: 0 microversion: 2.1 time: 0.124731 Feb 08 17:29:42.581796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 94/190] 10.222.0.69 () {58 vars in 1247 bytes} [Tue Feb 8 17:29:42 2022] DELETE /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:29:42.604825 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6aa53d40-854c-475e-8148-91d74aa501b4 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Calling method '.version_select at 0x7fd9fad0aa60>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:42.713746 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6aa53d40-854c-475e-8148-91d74aa501b4 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee" status: 200 len: 353 microversion: 2.1 time: 0.128693 Feb 08 17:29:42.721630 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 97/191] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:29:42 2022] GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:42.985072 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6e7a8c47-40b0-4786-8fb2-49d30a392bd7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:42.986324 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6e7a8c47-40b0-4786-8fb2-49d30a392bd7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:43.009264 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6e7a8c47-40b0-4786-8fb2-49d30a392bd7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:43.009718 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6e7a8c47-40b0-4786-8fb2-49d30a392bd7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:43.010527 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6e7a8c47-40b0-4786-8fb2-49d30a392bd7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:43.010959 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6e7a8c47-40b0-4786-8fb2-49d30a392bd7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:43.294802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6e7a8c47-40b0-4786-8fb2-49d30a392bd7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:43.308115 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6e7a8c47-40b0-4786-8fb2-49d30a392bd7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.328618 Feb 08 17:29:43.309268 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 95/192] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:42 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:43.732200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a51bf5c4-795d-4a5f-b26c-3547b9f4d222 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Calling method '.version_select at 0x7fd9f9b565e0>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:43.838768 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a51bf5c4-795d-4a5f-b26c-3547b9f4d222 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee" status: 200 len: 353 microversion: 2.1 time: 0.113421 Feb 08 17:29:43.839997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 98/193] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:29:43 2022] GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:29:44.328378 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-111fd31a-3d47-4f5d-9ee8-bc1bfac3c70e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:44.329021 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-111fd31a-3d47-4f5d-9ee8-bc1bfac3c70e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:44.335905 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-111fd31a-3d47-4f5d-9ee8-bc1bfac3c70e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:44.336264 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-111fd31a-3d47-4f5d-9ee8-bc1bfac3c70e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:44.337070 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-111fd31a-3d47-4f5d-9ee8-bc1bfac3c70e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:44.337557 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-111fd31a-3d47-4f5d-9ee8-bc1bfac3c70e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:44.533562 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-111fd31a-3d47-4f5d-9ee8-bc1bfac3c70e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:44.542265 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-111fd31a-3d47-4f5d-9ee8-bc1bfac3c70e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.217476 Feb 08 17:29:44.542863 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 96/194] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:44 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:44.855309 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e505af99-f518-4df5-8495-a9fd6c92180a tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Calling method '.version_select at 0x7fd9f9b561f0>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:44.932174 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e505af99-f518-4df5-8495-a9fd6c92180a tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee" status: 200 len: 353 microversion: 2.1 time: 0.080281 Feb 08 17:29:44.932747 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 99/195] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:29:44 2022] GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee => generated 353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:45.560631 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1d1175f9-8fec-4856-82a5-adf5bad08315 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:45.561417 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1d1175f9-8fec-4856-82a5-adf5bad08315 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:45.568642 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d1175f9-8fec-4856-82a5-adf5bad08315 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:45.570768 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d1175f9-8fec-4856-82a5-adf5bad08315 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:45.571618 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d1175f9-8fec-4856-82a5-adf5bad08315 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:45.572089 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d1175f9-8fec-4856-82a5-adf5bad08315 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:45.770521 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1d1175f9-8fec-4856-82a5-adf5bad08315 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:45.782133 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1d1175f9-8fec-4856-82a5-adf5bad08315 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.225265 Feb 08 17:29:45.782782 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 97/196] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:45 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:45.951249 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a354a87e-2c63-4310-a6eb-cc5bb35c50b4 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Calling method '.version_select at 0x7fd9fad0af70>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:46.039188 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a354a87e-2c63-4310-a6eb-cc5bb35c50b4 tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee" status: 200 len: 353 microversion: 2.1 time: 0.094733 Feb 08 17:29:46.040377 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 100/197] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:29:45 2022] GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:29:46.636154 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2121167026", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "networks": [{"uuid": "c7086d13-3d57-4d17-8071-713a64bd1f29"}]}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:29:46.709449 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.network.neutron [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] validate_networks() for [('c7086d13-3d57-4d17-8071-713a64bd1f29', None, None, None, None, None)] {{(pid=116480) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:29:46.805329 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7676cdea-edbe-44c9-a963-f1373a0ee8f8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:46.806437 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7676cdea-edbe-44c9-a963-f1373a0ee8f8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:46.816702 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7676cdea-edbe-44c9-a963-f1373a0ee8f8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:46.818029 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7676cdea-edbe-44c9-a963-f1373a0ee8f8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:46.819889 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7676cdea-edbe-44c9-a963-f1373a0ee8f8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:46.820478 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7676cdea-edbe-44c9-a963-f1373a0ee8f8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:47.072478 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-7676cdea-edbe-44c9-a963-f1373a0ee8f8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:47.090241 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7676cdea-edbe-44c9-a963-f1373a0ee8f8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.290887 Feb 08 17:29:47.091349 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 101/198] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:46 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:47.108664 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-74d55906-7de8-4ef0-8676-5e1f3736f42e tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Calling method '.version_select at 0x7fd9f9b56040>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:47.162388 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-74d55906-7de8-4ef0-8676-5e1f3736f42e tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] HTTP exception thrown: Volume 6c1139ba-3500-4fc1-97bb-be5288fe1cee could not be found. Feb 08 17:29:47.163728 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-74d55906-7de8-4ef0-8676-5e1f3736f42e tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] Returning 404 to user: Volume 6c1139ba-3500-4fc1-97bb-be5288fe1cee could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:29:47.165147 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-74d55906-7de8-4ef0-8676-5e1f3736f42e tempest-VolumesGetTestJSON-1233251092 tempest-VolumesGetTestJSON-1233251092-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee" status: 404 len: 109 microversion: 2.1 time: 0.072046 Feb 08 17:29:47.166227 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 102/199] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:29:47 2022] GET /compute/v2.1/os-volumes/6c1139ba-3500-4fc1-97bb-be5288fe1cee => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:29:47.342671 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Flavor limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:29:47.343216 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Image limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:29:47.344020 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Flavor pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:29:47.344859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Image pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:29:47.346227 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:29:47.360992 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:47.361767 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:47.362966 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:47.363641 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:47.398090 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Getting quotas for project b57af0d0aa794073a318653dc7c14c5e. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:29:47.405618 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Getting quotas for user 9cd9d3aa05e94f08a96a479e292141ae and project b57af0d0aa794073a318653dc7c14c5e. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:29:47.423717 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Going to run 1 instances... {{(pid=116480) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:29:47.428066 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116480) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:29:47.511435 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7d475be0-e997-495b-bbcb-aac71f8a272b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886588 Feb 08 17:29:47.518996 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 98/200] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:29:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:29:47.527507 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3ee4009c-0dee-49fe-83b3-c95ff79d3be9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:47.530510 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3ee4009c-0dee-49fe-83b3-c95ff79d3be9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:47.647072 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3ee4009c-0dee-49fe-83b3-c95ff79d3be9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:47.658771 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3ee4009c-0dee-49fe-83b3-c95ff79d3be9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1214 microversion: 2.1 time: 0.137866 Feb 08 17:29:47.677191 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 103/201] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:47 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:48.109208 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ec6ea529-4673-40c9-9791-f9a6ac62b6a5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:48.109842 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ec6ea529-4673-40c9-9791-f9a6ac62b6a5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:48.118762 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ec6ea529-4673-40c9-9791-f9a6ac62b6a5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:48.119215 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ec6ea529-4673-40c9-9791-f9a6ac62b6a5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:48.120008 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ec6ea529-4673-40c9-9791-f9a6ac62b6a5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:48.120581 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ec6ea529-4673-40c9-9791-f9a6ac62b6a5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:48.523836 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ec6ea529-4673-40c9-9791-f9a6ac62b6a5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:48.548404 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ec6ea529-4673-40c9-9791-f9a6ac62b6a5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.443290 Feb 08 17:29:48.554233 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 99/202] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:48 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:48.701709 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5bca86cb-7ff6-4a0c-acf7-8cfe1db9d523 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:48.704284 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5bca86cb-7ff6-4a0c-acf7-8cfe1db9d523 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:48.716600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5bca86cb-7ff6-4a0c-acf7-8cfe1db9d523 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:48.716600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5bca86cb-7ff6-4a0c-acf7-8cfe1db9d523 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:48.718592 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5bca86cb-7ff6-4a0c-acf7-8cfe1db9d523 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:48.719470 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5bca86cb-7ff6-4a0c-acf7-8cfe1db9d523 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:48.846152 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5bca86cb-7ff6-4a0c-acf7-8cfe1db9d523 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:48.861522 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5bca86cb-7ff6-4a0c-acf7-8cfe1db9d523 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1210 microversion: 2.1 time: 0.173853 Feb 08 17:29:48.863711 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 104/203] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:48 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1210 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:49.583752 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-099affe1-39b3-4621-bdbf-5a11879b4269 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:49.584754 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-099affe1-39b3-4621-bdbf-5a11879b4269 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:49.610027 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-099affe1-39b3-4621-bdbf-5a11879b4269 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:49.610564 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-099affe1-39b3-4621-bdbf-5a11879b4269 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:49.611374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-099affe1-39b3-4621-bdbf-5a11879b4269 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:49.613469 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-099affe1-39b3-4621-bdbf-5a11879b4269 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:49.899397 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f850b3d1-f4c7-4a1f-ac94-460d46c8ad27 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:49.901665 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f850b3d1-f4c7-4a1f-ac94-460d46c8ad27 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:49.933705 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f850b3d1-f4c7-4a1f-ac94-460d46c8ad27 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:49.942326 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f850b3d1-f4c7-4a1f-ac94-460d46c8ad27 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:49.944517 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f850b3d1-f4c7-4a1f-ac94-460d46c8ad27 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:49.951575 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f850b3d1-f4c7-4a1f-ac94-460d46c8ad27 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:50.101678 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-099affe1-39b3-4621-bdbf-5a11879b4269 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:50.124838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-099affe1-39b3-4621-bdbf-5a11879b4269 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.547825 Feb 08 17:29:50.127458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 100/204] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:49 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:50.236098 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f850b3d1-f4c7-4a1f-ac94-460d46c8ad27 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:50.258969 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f850b3d1-f4c7-4a1f-ac94-460d46c8ad27 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1272 microversion: 2.1 time: 0.372544 Feb 08 17:29:50.271826 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 105/205] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:49 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1272 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:51.160817 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ab5334b3-a173-42fd-898f-e0fcd7e8af1a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:51.161933 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ab5334b3-a173-42fd-898f-e0fcd7e8af1a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:51.175325 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ab5334b3-a173-42fd-898f-e0fcd7e8af1a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:51.175325 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ab5334b3-a173-42fd-898f-e0fcd7e8af1a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:51.176183 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ab5334b3-a173-42fd-898f-e0fcd7e8af1a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:51.177150 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ab5334b3-a173-42fd-898f-e0fcd7e8af1a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:51.280658 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6f0f6ab8-f740-4f3a-b184-e6d7e65ba4fd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:51.281516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6f0f6ab8-f740-4f3a-b184-e6d7e65ba4fd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:51.290056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6f0f6ab8-f740-4f3a-b184-e6d7e65ba4fd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:51.290699 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6f0f6ab8-f740-4f3a-b184-e6d7e65ba4fd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:51.292020 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6f0f6ab8-f740-4f3a-b184-e6d7e65ba4fd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:51.292588 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6f0f6ab8-f740-4f3a-b184-e6d7e65ba4fd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:51.389839 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ab5334b3-a173-42fd-898f-e0fcd7e8af1a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:51.404556 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ab5334b3-a173-42fd-898f-e0fcd7e8af1a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.250153 Feb 08 17:29:51.405548 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 101/206] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:51 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:51.498444 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6f0f6ab8-f740-4f3a-b184-e6d7e65ba4fd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:51.506900 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6f0f6ab8-f740-4f3a-b184-e6d7e65ba4fd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.230306 Feb 08 17:29:51.507584 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 106/207] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:51 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:52.425194 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a0dbebf3-7fe6-4bdc-8dd3-99864c870104 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:52.425808 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a0dbebf3-7fe6-4bdc-8dd3-99864c870104 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:52.433137 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a0dbebf3-7fe6-4bdc-8dd3-99864c870104 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:52.433609 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a0dbebf3-7fe6-4bdc-8dd3-99864c870104 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:52.434519 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a0dbebf3-7fe6-4bdc-8dd3-99864c870104 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:52.435048 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a0dbebf3-7fe6-4bdc-8dd3-99864c870104 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:52.527294 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d66a7d9b-4e89-481f-b800-d1d9ce81299a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:52.528357 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d66a7d9b-4e89-481f-b800-d1d9ce81299a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:52.534998 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d66a7d9b-4e89-481f-b800-d1d9ce81299a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:52.535459 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d66a7d9b-4e89-481f-b800-d1d9ce81299a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:52.536266 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d66a7d9b-4e89-481f-b800-d1d9ce81299a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:52.536703 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d66a7d9b-4e89-481f-b800-d1d9ce81299a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:52.612445 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a0dbebf3-7fe6-4bdc-8dd3-99864c870104 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:52.624835 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a0dbebf3-7fe6-4bdc-8dd3-99864c870104 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.203189 Feb 08 17:29:52.625773 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 102/208] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:52 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:52.704558 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d66a7d9b-4e89-481f-b800-d1d9ce81299a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:52.720253 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d66a7d9b-4e89-481f-b800-d1d9ce81299a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.198294 Feb 08 17:29:52.721123 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 107/209] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:52 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:53.649527 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ea02f390-f941-4130-adff-bc52356423dd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:53.650566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ea02f390-f941-4130-adff-bc52356423dd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:53.659467 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ea02f390-f941-4130-adff-bc52356423dd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:53.660172 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ea02f390-f941-4130-adff-bc52356423dd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:53.661944 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ea02f390-f941-4130-adff-bc52356423dd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:53.661944 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ea02f390-f941-4130-adff-bc52356423dd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:53.739870 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4eee6b90-c3f6-4c52-94c1-4777483cfdfd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:53.740866 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4eee6b90-c3f6-4c52-94c1-4777483cfdfd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:53.763439 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4eee6b90-c3f6-4c52-94c1-4777483cfdfd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:53.764657 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4eee6b90-c3f6-4c52-94c1-4777483cfdfd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:53.765836 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4eee6b90-c3f6-4c52-94c1-4777483cfdfd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:53.766490 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4eee6b90-c3f6-4c52-94c1-4777483cfdfd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:53.918282 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ea02f390-f941-4130-adff-bc52356423dd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:53.927322 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ea02f390-f941-4130-adff-bc52356423dd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.282234 Feb 08 17:29:53.928338 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 103/210] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:53 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:54.246991 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4eee6b90-c3f6-4c52-94c1-4777483cfdfd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:54.263628 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4eee6b90-c3f6-4c52-94c1-4777483cfdfd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.527841 Feb 08 17:29:54.278526 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 108/211] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:53 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:54.968896 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6d545d64-db1b-46c6-beba-d3599054f7c4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:54.970371 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6d545d64-db1b-46c6-beba-d3599054f7c4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:55.018479 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6d545d64-db1b-46c6-beba-d3599054f7c4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:55.025623 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6d545d64-db1b-46c6-beba-d3599054f7c4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:55.028585 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6d545d64-db1b-46c6-beba-d3599054f7c4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:55.033775 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6d545d64-db1b-46c6-beba-d3599054f7c4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:55.193372 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-5c5af759-1448-4b32-bad3-d787efd5bcb9 req-2d4430ef-ca97-47ce-ae45-72a65f68bcce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4013c2da-f6fd-458b-860c-3683c05bc99d", "tag": "3bb8fcc0-8e97-4a33-b4db-474a2d5f11ff"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:29:55.199898 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:29:55.199898 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:29:55.242091 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-5c5af759-1448-4b32-bad3-d787efd5bcb9 req-2d4430ef-ca97-47ce-ae45-72a65f68bcce service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:55.242764 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-5c5af759-1448-4b32-bad3-d787efd5bcb9 req-2d4430ef-ca97-47ce-ae45-72a65f68bcce service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:55.316818 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-5c5af759-1448-4b32-bad3-d787efd5bcb9 req-2d4430ef-ca97-47ce-ae45-72a65f68bcce service nova] Creating event network-changed:3bb8fcc0-8e97-4a33-b4db-474a2d5f11ff for instance 4013c2da-f6fd-458b-860c-3683c05bc99d on hv-cinder-82204 Feb 08 17:29:55.329412 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-5c5af759-1448-4b32-bad3-d787efd5bcb9 req-2d4430ef-ca97-47ce-ae45-72a65f68bcce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143259 Feb 08 17:29:55.330423 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 109/212] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:29:55.341217 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ec4797e5-344a-492d-afc3-e636e6da0a87 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:55.343056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ec4797e5-344a-492d-afc3-e636e6da0a87 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:55.354638 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ec4797e5-344a-492d-afc3-e636e6da0a87 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:55.355717 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ec4797e5-344a-492d-afc3-e636e6da0a87 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:55.357394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ec4797e5-344a-492d-afc3-e636e6da0a87 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:55.358354 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ec4797e5-344a-492d-afc3-e636e6da0a87 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:55.495650 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6d545d64-db1b-46c6-beba-d3599054f7c4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:55.511550 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6d545d64-db1b-46c6-beba-d3599054f7c4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1522 microversion: 2.1 time: 0.548471 Feb 08 17:29:55.513490 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 104/213] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:54 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:29:55.760102 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ec4797e5-344a-492d-afc3-e636e6da0a87 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:55.768165 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ec4797e5-344a-492d-afc3-e636e6da0a87 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.435551 Feb 08 17:29:55.779892 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 110/214] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:55 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:56.541968 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-da428a1d-89f3-420d-b777-71c70a8c37fb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:56.543670 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-da428a1d-89f3-420d-b777-71c70a8c37fb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:56.555659 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-da428a1d-89f3-420d-b777-71c70a8c37fb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:56.556511 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-da428a1d-89f3-420d-b777-71c70a8c37fb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:56.557615 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-da428a1d-89f3-420d-b777-71c70a8c37fb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:56.558453 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-da428a1d-89f3-420d-b777-71c70a8c37fb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:56.811984 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1d34ca58-075b-431b-bb42-6ad09619ecda tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:56.812896 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1d34ca58-075b-431b-bb42-6ad09619ecda tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:56.822001 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1d34ca58-075b-431b-bb42-6ad09619ecda tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:56.822587 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1d34ca58-075b-431b-bb42-6ad09619ecda tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:56.824590 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1d34ca58-075b-431b-bb42-6ad09619ecda tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:56.825042 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1d34ca58-075b-431b-bb42-6ad09619ecda tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:56.899649 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-da428a1d-89f3-420d-b777-71c70a8c37fb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:56.927706 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-da428a1d-89f3-420d-b777-71c70a8c37fb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1502 microversion: 2.1 time: 0.391610 Feb 08 17:29:56.946705 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 105/215] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:56 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:56.961073 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b58fedc9-5bc2-4ebd-8465-3f18c12af690 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:56.962578 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-b58fedc9-5bc2-4ebd-8465-3f18c12af690 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:56.974820 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b58fedc9-5bc2-4ebd-8465-3f18c12af690 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:56.975946 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b58fedc9-5bc2-4ebd-8465-3f18c12af690 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:56.978217 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b58fedc9-5bc2-4ebd-8465-3f18c12af690 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:56.979402 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b58fedc9-5bc2-4ebd-8465-3f18c12af690 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:57.312488 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b58fedc9-5bc2-4ebd-8465-3f18c12af690 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:57.327699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b58fedc9-5bc2-4ebd-8465-3f18c12af690 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1515 microversion: 2.1 time: 0.373732 Feb 08 17:29:57.328980 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 106/216] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:56 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1515 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:57.527125 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1d34ca58-075b-431b-bb42-6ad09619ecda tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:57.536490 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1d34ca58-075b-431b-bb42-6ad09619ecda tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.730788 Feb 08 17:29:57.537082 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 111/217] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:56 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:58.564007 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fed9234c-d2c2-4dea-ba15-7f2f720ccc2d tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:58.565594 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-fed9234c-d2c2-4dea-ba15-7f2f720ccc2d tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:58.573404 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fed9234c-d2c2-4dea-ba15-7f2f720ccc2d tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:58.574181 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fed9234c-d2c2-4dea-ba15-7f2f720ccc2d tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:58.575124 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fed9234c-d2c2-4dea-ba15-7f2f720ccc2d tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:58.575712 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fed9234c-d2c2-4dea-ba15-7f2f720ccc2d tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:58.795907 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-fed9234c-d2c2-4dea-ba15-7f2f720ccc2d tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:58.812859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-fed9234c-d2c2-4dea-ba15-7f2f720ccc2d tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.252684 Feb 08 17:29:58.813880 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 107/218] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:58 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:59.064026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7245809f-09a7-4d91-9c24-1da7cfecd7ba tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:29:59.065679 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7245809f-09a7-4d91-9c24-1da7cfecd7ba tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:59.075932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7245809f-09a7-4d91-9c24-1da7cfecd7ba tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:59.076887 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7245809f-09a7-4d91-9c24-1da7cfecd7ba tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:59.078900 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7245809f-09a7-4d91-9c24-1da7cfecd7ba tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:59.080001 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7245809f-09a7-4d91-9c24-1da7cfecd7ba tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:59.186456 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-7245809f-09a7-4d91-9c24-1da7cfecd7ba tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lazy-loading 'flavor' on Instance uuid 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:29:59.421359 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7245809f-09a7-4d91-9c24-1da7cfecd7ba tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/action" status: 200 len: 32 microversion: 2.1 time: 0.364969 Feb 08 17:29:59.423003 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 112/219] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:29:59 2022] POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/action => generated 32 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 17:29:59.438642 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-558f1a37-a264-4d74-95ab-7f9c52bc1831 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:59.439681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-558f1a37-a264-4d74-95ab-7f9c52bc1831 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:59.454541 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-558f1a37-a264-4d74-95ab-7f9c52bc1831 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:59.462151 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-558f1a37-a264-4d74-95ab-7f9c52bc1831 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:59.467793 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-558f1a37-a264-4d74-95ab-7f9c52bc1831 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:59.468513 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-558f1a37-a264-4d74-95ab-7f9c52bc1831 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:59.756530 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-558f1a37-a264-4d74-95ab-7f9c52bc1831 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:29:59.780950 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-558f1a37-a264-4d74-95ab-7f9c52bc1831 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.348145 Feb 08 17:29:59.782399 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 108/220] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:59 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:29:59.843116 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c14d1d18-0457-4a13-86a9-ea0dd8a91bf8 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:29:59.844668 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c14d1d18-0457-4a13-86a9-ea0dd8a91bf8 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:29:59.856794 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c14d1d18-0457-4a13-86a9-ea0dd8a91bf8 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:59.857992 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c14d1d18-0457-4a13-86a9-ea0dd8a91bf8 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:29:59.859956 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c14d1d18-0457-4a13-86a9-ea0dd8a91bf8 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:29:59.861210 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c14d1d18-0457-4a13-86a9-ea0dd8a91bf8 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:00.283912 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-c14d1d18-0457-4a13-86a9-ea0dd8a91bf8 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:00.299997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c14d1d18-0457-4a13-86a9-ea0dd8a91bf8 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.464967 Feb 08 17:30:00.300603 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 113/221] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:29:59 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:00.809825 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-667aa607-a289-4ea5-a2b0-744e7d6ba76c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:00.812312 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-667aa607-a289-4ea5-a2b0-744e7d6ba76c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:00.822731 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-667aa607-a289-4ea5-a2b0-744e7d6ba76c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:00.823818 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-667aa607-a289-4ea5-a2b0-744e7d6ba76c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:00.825406 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-667aa607-a289-4ea5-a2b0-744e7d6ba76c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:00.826346 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-667aa607-a289-4ea5-a2b0-744e7d6ba76c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:01.158620 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-667aa607-a289-4ea5-a2b0-744e7d6ba76c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:01.168836 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-667aa607-a289-4ea5-a2b0-744e7d6ba76c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.365667 Feb 08 17:30:01.170157 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 109/222] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:00 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:01.324623 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-be6f1b53-d25d-4a3e-8363-b77e35d02970 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:01.325755 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-be6f1b53-d25d-4a3e-8363-b77e35d02970 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:01.337006 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be6f1b53-d25d-4a3e-8363-b77e35d02970 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:01.338000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be6f1b53-d25d-4a3e-8363-b77e35d02970 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:01.339378 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be6f1b53-d25d-4a3e-8363-b77e35d02970 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:01.340198 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be6f1b53-d25d-4a3e-8363-b77e35d02970 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:01.628056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-be6f1b53-d25d-4a3e-8363-b77e35d02970 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:01.643934 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-be6f1b53-d25d-4a3e-8363-b77e35d02970 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.326786 Feb 08 17:30:01.644538 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 114/223] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:01 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:02.195919 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9cf747fe-40e6-473d-9a11-d0055556c815 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:02.197857 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9cf747fe-40e6-473d-9a11-d0055556c815 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:02.205466 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cf747fe-40e6-473d-9a11-d0055556c815 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:02.206233 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cf747fe-40e6-473d-9a11-d0055556c815 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:02.207336 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cf747fe-40e6-473d-9a11-d0055556c815 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:02.207884 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cf747fe-40e6-473d-9a11-d0055556c815 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:02.491198 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9cf747fe-40e6-473d-9a11-d0055556c815 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:02.508945 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9cf747fe-40e6-473d-9a11-d0055556c815 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.319781 Feb 08 17:30:02.510559 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 110/224] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:02 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:02.676329 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-553b5d9f-a859-4c5e-8ab2-346d0dc5e3da tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:02.677602 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-553b5d9f-a859-4c5e-8ab2-346d0dc5e3da tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:02.708300 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-553b5d9f-a859-4c5e-8ab2-346d0dc5e3da tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:02.709277 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-553b5d9f-a859-4c5e-8ab2-346d0dc5e3da tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:02.710800 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-553b5d9f-a859-4c5e-8ab2-346d0dc5e3da tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:02.711789 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-553b5d9f-a859-4c5e-8ab2-346d0dc5e3da tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:03.059909 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-553b5d9f-a859-4c5e-8ab2-346d0dc5e3da tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:03.080699 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-553b5d9f-a859-4c5e-8ab2-346d0dc5e3da tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.411521 Feb 08 17:30:03.082110 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 115/225] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:02 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:03.540365 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a22824bc-4fec-499b-be0f-865188607ca1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:03.542347 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a22824bc-4fec-499b-be0f-865188607ca1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:03.552096 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a22824bc-4fec-499b-be0f-865188607ca1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:03.553420 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a22824bc-4fec-499b-be0f-865188607ca1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:03.554858 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a22824bc-4fec-499b-be0f-865188607ca1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:03.561223 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a22824bc-4fec-499b-be0f-865188607ca1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:03.815593 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a22824bc-4fec-499b-be0f-865188607ca1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:03.829852 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a22824bc-4fec-499b-be0f-865188607ca1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.295406 Feb 08 17:30:03.831007 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 111/226] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:03 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:04.114200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-820fe94a-51b0-47c7-abc5-cbdfe280024e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:04.115577 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-820fe94a-51b0-47c7-abc5-cbdfe280024e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:04.127410 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-820fe94a-51b0-47c7-abc5-cbdfe280024e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:04.128221 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-820fe94a-51b0-47c7-abc5-cbdfe280024e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:04.131168 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-820fe94a-51b0-47c7-abc5-cbdfe280024e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:04.132083 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-820fe94a-51b0-47c7-abc5-cbdfe280024e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:04.443154 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-820fe94a-51b0-47c7-abc5-cbdfe280024e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:04.470358 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-820fe94a-51b0-47c7-abc5-cbdfe280024e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.363086 Feb 08 17:30:04.471823 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 116/227] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:04 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:04.855820 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f0fa4c9e-cc0d-427f-94ba-3bdba0f9e6b7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:04.856785 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f0fa4c9e-cc0d-427f-94ba-3bdba0f9e6b7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:04.882178 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f0fa4c9e-cc0d-427f-94ba-3bdba0f9e6b7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:04.882635 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f0fa4c9e-cc0d-427f-94ba-3bdba0f9e6b7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:04.883709 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f0fa4c9e-cc0d-427f-94ba-3bdba0f9e6b7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:04.884304 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f0fa4c9e-cc0d-427f-94ba-3bdba0f9e6b7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:05.172024 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f0fa4c9e-cc0d-427f-94ba-3bdba0f9e6b7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:05.193093 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-6c9b2cc0-234c-45e0-aa08-2ada4760fa48 req-f174f66a-56a4-4d02-9792-548ae18df806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4013c2da-f6fd-458b-860c-3683c05bc99d", "name": "network-vif-plugged", "status": "completed", "tag": "3bb8fcc0-8e97-4a33-b4db-474a2d5f11ff"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:05.200726 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:30:05.200726 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:30:05.203900 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f0fa4c9e-cc0d-427f-94ba-3bdba0f9e6b7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.355867 Feb 08 17:30:05.207513 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 112/228] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:04 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:05.213594 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-6c9b2cc0-234c-45e0-aa08-2ada4760fa48 req-f174f66a-56a4-4d02-9792-548ae18df806 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:05.214148 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-6c9b2cc0-234c-45e0-aa08-2ada4760fa48 req-f174f66a-56a4-4d02-9792-548ae18df806 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:05.233712 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-6c9b2cc0-234c-45e0-aa08-2ada4760fa48 req-f174f66a-56a4-4d02-9792-548ae18df806 service nova] Creating event network-vif-plugged:3bb8fcc0-8e97-4a33-b4db-474a2d5f11ff for instance 4013c2da-f6fd-458b-860c-3683c05bc99d on hv-cinder-82204 Feb 08 17:30:05.244952 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-6c9b2cc0-234c-45e0-aa08-2ada4760fa48 req-f174f66a-56a4-4d02-9792-548ae18df806 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061519 Feb 08 17:30:05.246164 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 117/229] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:30:05.493796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-cbdfbd7e-9492-4893-80b9-189f119024c1 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:05.494621 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-cbdfbd7e-9492-4893-80b9-189f119024c1 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:05.501913 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cbdfbd7e-9492-4893-80b9-189f119024c1 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:05.502458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cbdfbd7e-9492-4893-80b9-189f119024c1 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:05.503400 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cbdfbd7e-9492-4893-80b9-189f119024c1 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:05.503902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cbdfbd7e-9492-4893-80b9-189f119024c1 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:05.687577 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-cbdfbd7e-9492-4893-80b9-189f119024c1 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:05.695703 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-cbdfbd7e-9492-4893-80b9-189f119024c1 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.206846 Feb 08 17:30:05.696272 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 113/230] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:05 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:06.232280 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e3ba30dd-bcea-477d-93a3-991eba7dd38b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:06.233407 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-e3ba30dd-bcea-477d-93a3-991eba7dd38b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:06.240750 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e3ba30dd-bcea-477d-93a3-991eba7dd38b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:06.241256 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e3ba30dd-bcea-477d-93a3-991eba7dd38b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:06.242593 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e3ba30dd-bcea-477d-93a3-991eba7dd38b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:06.243026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e3ba30dd-bcea-477d-93a3-991eba7dd38b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:06.447899 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e3ba30dd-bcea-477d-93a3-991eba7dd38b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:06.458731 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e3ba30dd-bcea-477d-93a3-991eba7dd38b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.232531 Feb 08 17:30:06.459344 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 118/231] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:06 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:06.713143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b5984b18-46b2-4e87-9db1-7ac44ea51c07 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:06.714236 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-b5984b18-46b2-4e87-9db1-7ac44ea51c07 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:06.724834 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b5984b18-46b2-4e87-9db1-7ac44ea51c07 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:06.725516 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b5984b18-46b2-4e87-9db1-7ac44ea51c07 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:06.727186 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b5984b18-46b2-4e87-9db1-7ac44ea51c07 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:06.727779 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b5984b18-46b2-4e87-9db1-7ac44ea51c07 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:06.943925 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b5984b18-46b2-4e87-9db1-7ac44ea51c07 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:06.959204 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b5984b18-46b2-4e87-9db1-7ac44ea51c07 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.250432 Feb 08 17:30:06.960613 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 114/232] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:06 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:07.482224 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-904c9d75-868c-485c-8caa-6534bd0dbad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:07.482962 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-904c9d75-868c-485c-8caa-6534bd0dbad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:07.489323 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-904c9d75-868c-485c-8caa-6534bd0dbad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:07.489776 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-904c9d75-868c-485c-8caa-6534bd0dbad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:07.490844 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-904c9d75-868c-485c-8caa-6534bd0dbad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:07.491296 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-904c9d75-868c-485c-8caa-6534bd0dbad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:07.705963 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-904c9d75-868c-485c-8caa-6534bd0dbad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:07.714137 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-904c9d75-868c-485c-8caa-6534bd0dbad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.235661 Feb 08 17:30:07.725001 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 119/233] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:07 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:07.991011 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-98f6e108-afa8-417f-87ab-8a32ee2ba7cf tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:07.994846 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-98f6e108-afa8-417f-87ab-8a32ee2ba7cf tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:08.017573 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-98f6e108-afa8-417f-87ab-8a32ee2ba7cf tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:08.017573 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-98f6e108-afa8-417f-87ab-8a32ee2ba7cf tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:08.017573 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-98f6e108-afa8-417f-87ab-8a32ee2ba7cf tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:08.017573 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-98f6e108-afa8-417f-87ab-8a32ee2ba7cf tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:08.348555 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-98f6e108-afa8-417f-87ab-8a32ee2ba7cf tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:08.374977 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-98f6e108-afa8-417f-87ab-8a32ee2ba7cf tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.398870 Feb 08 17:30:08.385232 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 115/234] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:07 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:08.737552 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2392f1c8-79f2-4442-bc8f-5f18387aeadc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:08.738721 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2392f1c8-79f2-4442-bc8f-5f18387aeadc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:08.747290 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2392f1c8-79f2-4442-bc8f-5f18387aeadc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:08.748015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2392f1c8-79f2-4442-bc8f-5f18387aeadc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:08.749085 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2392f1c8-79f2-4442-bc8f-5f18387aeadc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:08.749614 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2392f1c8-79f2-4442-bc8f-5f18387aeadc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:09.287669 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2392f1c8-79f2-4442-bc8f-5f18387aeadc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:09.297122 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2392f1c8-79f2-4442-bc8f-5f18387aeadc tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.568215 Feb 08 17:30:09.308334 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 120/235] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:08 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:09.395975 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8e14b89f-baa5-4b9a-b9e4-e9511e68b684 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:09.396594 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8e14b89f-baa5-4b9a-b9e4-e9511e68b684 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:09.404244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8e14b89f-baa5-4b9a-b9e4-e9511e68b684 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:09.405200 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8e14b89f-baa5-4b9a-b9e4-e9511e68b684 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:09.406523 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8e14b89f-baa5-4b9a-b9e4-e9511e68b684 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:09.407209 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8e14b89f-baa5-4b9a-b9e4-e9511e68b684 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:09.644028 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8e14b89f-baa5-4b9a-b9e4-e9511e68b684 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:09.660233 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8e14b89f-baa5-4b9a-b9e4-e9511e68b684 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1314 microversion: 2.1 time: 0.268264 Feb 08 17:30:09.661874 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 116/236] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:09 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:10.318231 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1cef63cb-5665-4ef8-9949-569bb767a002 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:10.320792 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1cef63cb-5665-4ef8-9949-569bb767a002 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:10.327244 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1cef63cb-5665-4ef8-9949-569bb767a002 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:10.327682 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1cef63cb-5665-4ef8-9949-569bb767a002 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:10.328577 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1cef63cb-5665-4ef8-9949-569bb767a002 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:10.329261 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1cef63cb-5665-4ef8-9949-569bb767a002 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:10.596310 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1cef63cb-5665-4ef8-9949-569bb767a002 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:10.610388 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1cef63cb-5665-4ef8-9949-569bb767a002 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.297271 Feb 08 17:30:10.612029 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 121/237] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:10 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:10.686516 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fbedfc36-b685-41b0-839d-089679aebbd9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:10.688990 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-fbedfc36-b685-41b0-839d-089679aebbd9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:10.702928 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fbedfc36-b685-41b0-839d-089679aebbd9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:10.703363 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fbedfc36-b685-41b0-839d-089679aebbd9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:10.705014 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fbedfc36-b685-41b0-839d-089679aebbd9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:10.705860 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fbedfc36-b685-41b0-839d-089679aebbd9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:10.931262 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-fbedfc36-b685-41b0-839d-089679aebbd9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:10.942802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-fbedfc36-b685-41b0-839d-089679aebbd9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1498 microversion: 2.1 time: 0.264618 Feb 08 17:30:10.943723 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 117/238] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:10 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1498 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:11.258981 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-70619776", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:11.357581 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.network.neutron [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] validate_networks() for None {{(pid=116479) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:30:11.642968 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-69741587-ef2d-4448-a260-1cd5c21e2114 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:11.643780 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-69741587-ef2d-4448-a260-1cd5c21e2114 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:11.654206 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69741587-ef2d-4448-a260-1cd5c21e2114 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:11.655019 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69741587-ef2d-4448-a260-1cd5c21e2114 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:11.657252 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69741587-ef2d-4448-a260-1cd5c21e2114 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:11.658351 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69741587-ef2d-4448-a260-1cd5c21e2114 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:11.913681 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Flavor limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:30:11.914421 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Image limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:30:11.915092 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Flavor pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:30:11.915626 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Image pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:30:11.916098 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:30:11.945908 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:11.946920 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:11.948937 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:11.949989 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:11.977880 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-69741587-ef2d-4448-a260-1cd5c21e2114 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:12.006012 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-69741587-ef2d-4448-a260-1cd5c21e2114 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.368183 Feb 08 17:30:12.008528 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 118/239] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:11 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:12.018363 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0aa4b0f2-24fa-4dea-9ced-871e2b16322b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:12.019531 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0aa4b0f2-24fa-4dea-9ced-871e2b16322b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:12.032655 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Getting quotas for project 700878fc54924d3ba0fa14041a48d947. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:30:12.034473 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0aa4b0f2-24fa-4dea-9ced-871e2b16322b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:12.035234 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0aa4b0f2-24fa-4dea-9ced-871e2b16322b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:12.036878 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0aa4b0f2-24fa-4dea-9ced-871e2b16322b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:12.038238 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0aa4b0f2-24fa-4dea-9ced-871e2b16322b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:12.042259 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Getting quotas for user c66c7746bed24ae89161e7337d297b9e and project 700878fc54924d3ba0fa14041a48d947. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:30:12.071657 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Going to run 1 instances... {{(pid=116479) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:30:12.079496 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:30:12.088682 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0aa4b0f2-24fa-4dea-9ced-871e2b16322b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:30:12.190007 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d0e61b6d-1457-4e14-ae7b-f17bbfc31f70 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.935308 Feb 08 17:30:12.202193 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 122/240] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:30:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 08 17:30:12.210146 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ca5a9a2a-767a-492e-a21e-22bdad4bf8d3 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:12.212445 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ca5a9a2a-767a-492e-a21e-22bdad4bf8d3 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:12.325277 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0aa4b0f2-24fa-4dea-9ced-871e2b16322b tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 204 len: 0 microversion: 2.1 time: 0.313930 Feb 08 17:30:12.327088 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 119/241] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:30:12 2022] DELETE /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:30:12.352797 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0a5c76c8-5f5f-44df-a201-62d704c834ff tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:12.354145 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0a5c76c8-5f5f-44df-a201-62d704c834ff tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:12.367242 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a5c76c8-5f5f-44df-a201-62d704c834ff tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:12.367820 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a5c76c8-5f5f-44df-a201-62d704c834ff tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:12.369239 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a5c76c8-5f5f-44df-a201-62d704c834ff tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:12.370009 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a5c76c8-5f5f-44df-a201-62d704c834ff tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:12.400426 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ca5a9a2a-767a-492e-a21e-22bdad4bf8d3 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:12.414538 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ca5a9a2a-767a-492e-a21e-22bdad4bf8d3 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1213 microversion: 2.1 time: 0.209813 Feb 08 17:30:12.415640 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 123/242] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:12 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1213 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:12.674393 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0a5c76c8-5f5f-44df-a201-62d704c834ff tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:12.684655 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0a5c76c8-5f5f-44df-a201-62d704c834ff tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1504 microversion: 2.1 time: 0.346744 Feb 08 17:30:12.685302 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 120/243] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:12 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:13.036473 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-be4ec1d4-80eb-4750-9db9-442680e0fb1d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:13.037517 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-be4ec1d4-80eb-4750-9db9-442680e0fb1d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:13.049620 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be4ec1d4-80eb-4750-9db9-442680e0fb1d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:13.050405 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be4ec1d4-80eb-4750-9db9-442680e0fb1d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:13.051795 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be4ec1d4-80eb-4750-9db9-442680e0fb1d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:13.052559 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be4ec1d4-80eb-4750-9db9-442680e0fb1d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:13.338434 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-be4ec1d4-80eb-4750-9db9-442680e0fb1d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:13.352301 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-be4ec1d4-80eb-4750-9db9-442680e0fb1d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.323464 Feb 08 17:30:13.355757 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 124/244] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:13 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:13.447139 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9b86e338-8901-412b-a9a6-aa4864a00f24 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:13.448347 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9b86e338-8901-412b-a9a6-aa4864a00f24 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:13.460280 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9b86e338-8901-412b-a9a6-aa4864a00f24 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:13.460958 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9b86e338-8901-412b-a9a6-aa4864a00f24 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:13.462285 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9b86e338-8901-412b-a9a6-aa4864a00f24 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:13.463007 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9b86e338-8901-412b-a9a6-aa4864a00f24 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:13.599580 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9b86e338-8901-412b-a9a6-aa4864a00f24 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:13.616362 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9b86e338-8901-412b-a9a6-aa4864a00f24 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1265 microversion: 2.1 time: 0.175482 Feb 08 17:30:13.620511 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 121/245] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:13 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:13.719150 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bd81f6b8-7d31-41a7-b05e-c9c6e1ead8a9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:13.720287 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-bd81f6b8-7d31-41a7-b05e-c9c6e1ead8a9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:13.731553 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bd81f6b8-7d31-41a7-b05e-c9c6e1ead8a9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:13.732675 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bd81f6b8-7d31-41a7-b05e-c9c6e1ead8a9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:13.734915 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bd81f6b8-7d31-41a7-b05e-c9c6e1ead8a9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:13.735990 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bd81f6b8-7d31-41a7-b05e-c9c6e1ead8a9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:14.014218 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bd81f6b8-7d31-41a7-b05e-c9c6e1ead8a9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:14.031751 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bd81f6b8-7d31-41a7-b05e-c9c6e1ead8a9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1504 microversion: 2.1 time: 0.319685 Feb 08 17:30:14.034182 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 125/246] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:13 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1504 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:14.407242 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2f82a99b-4050-431e-8f56-aeabc0ce2711 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:14.414725 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2f82a99b-4050-431e-8f56-aeabc0ce2711 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:14.433852 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f82a99b-4050-431e-8f56-aeabc0ce2711 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:14.435240 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f82a99b-4050-431e-8f56-aeabc0ce2711 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:14.437639 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f82a99b-4050-431e-8f56-aeabc0ce2711 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:14.438377 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f82a99b-4050-431e-8f56-aeabc0ce2711 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:14.659858 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-119683e5-1e23-419c-92fa-16d5986840c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:14.661883 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-119683e5-1e23-419c-92fa-16d5986840c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:14.680220 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-119683e5-1e23-419c-92fa-16d5986840c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:14.681829 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-119683e5-1e23-419c-92fa-16d5986840c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:14.683786 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-119683e5-1e23-419c-92fa-16d5986840c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:14.684982 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-119683e5-1e23-419c-92fa-16d5986840c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:14.724153 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2f82a99b-4050-431e-8f56-aeabc0ce2711 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:14.748046 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2f82a99b-4050-431e-8f56-aeabc0ce2711 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.359258 Feb 08 17:30:14.749534 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 122/247] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:14 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:14.821435 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-119683e5-1e23-419c-92fa-16d5986840c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:14.833667 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-119683e5-1e23-419c-92fa-16d5986840c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1271 microversion: 2.1 time: 0.185386 Feb 08 17:30:14.834401 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 126/248] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:14 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:15.064791 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b4c9dea7-77bb-41e4-b01c-ea6fb08b21d9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:15.065685 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-b4c9dea7-77bb-41e4-b01c-ea6fb08b21d9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:15.073518 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b4c9dea7-77bb-41e4-b01c-ea6fb08b21d9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:15.074395 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b4c9dea7-77bb-41e4-b01c-ea6fb08b21d9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:15.075714 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b4c9dea7-77bb-41e4-b01c-ea6fb08b21d9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:15.076274 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b4c9dea7-77bb-41e4-b01c-ea6fb08b21d9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:15.576559 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b4c9dea7-77bb-41e4-b01c-ea6fb08b21d9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:15.596934 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b4c9dea7-77bb-41e4-b01c-ea6fb08b21d9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1504 microversion: 2.1 time: 0.541605 Feb 08 17:30:15.617845 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 123/249] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:15 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1504 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:15.776802 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0db590c1-9f38-4c6f-b29c-a36a3638c19f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:15.778310 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0db590c1-9f38-4c6f-b29c-a36a3638c19f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:15.790344 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0db590c1-9f38-4c6f-b29c-a36a3638c19f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:15.791858 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0db590c1-9f38-4c6f-b29c-a36a3638c19f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:15.795243 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0db590c1-9f38-4c6f-b29c-a36a3638c19f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:15.796405 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0db590c1-9f38-4c6f-b29c-a36a3638c19f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:15.861251 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a4e1d82b-857d-4797-b6b0-923e06eaa97b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:15.863142 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a4e1d82b-857d-4797-b6b0-923e06eaa97b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:15.878961 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4e1d82b-857d-4797-b6b0-923e06eaa97b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:15.886341 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4e1d82b-857d-4797-b6b0-923e06eaa97b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:15.887933 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4e1d82b-857d-4797-b6b0-923e06eaa97b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:15.888735 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4e1d82b-857d-4797-b6b0-923e06eaa97b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:16.249582 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a4e1d82b-857d-4797-b6b0-923e06eaa97b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:16.264320 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a4e1d82b-857d-4797-b6b0-923e06eaa97b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.410659 Feb 08 17:30:16.275492 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 124/250] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:15 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:16.306129 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0db590c1-9f38-4c6f-b29c-a36a3638c19f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:16.323080 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0db590c1-9f38-4c6f-b29c-a36a3638c19f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.554675 Feb 08 17:30:16.325176 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 127/251] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:15 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:16.628628 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-29283a33-6c0c-4c34-bf57-f1989fedd872 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:16.630237 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-29283a33-6c0c-4c34-bf57-f1989fedd872 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:16.638427 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-29283a33-6c0c-4c34-bf57-f1989fedd872 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:16.639173 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-29283a33-6c0c-4c34-bf57-f1989fedd872 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:16.640070 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-29283a33-6c0c-4c34-bf57-f1989fedd872 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:16.640607 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-29283a33-6c0c-4c34-bf57-f1989fedd872 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:16.837590 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-29283a33-6c0c-4c34-bf57-f1989fedd872 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:16.847150 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-29283a33-6c0c-4c34-bf57-f1989fedd872 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 200 len: 1462 microversion: 2.1 time: 0.223977 Feb 08 17:30:16.848134 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-8b81f436-f89b-44cb-b16a-6749b6060234 req-8bc10a09-7baf-4bb2-8e20-90feca665daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4013c2da-f6fd-458b-860c-3683c05bc99d", "name": "network-vif-deleted", "tag": "3bb8fcc0-8e97-4a33-b4db-474a2d5f11ff"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:16.849047 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 125/252] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:16 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 1462 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:16.851506 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:30:16.851506 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:30:16.869631 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-8b81f436-f89b-44cb-b16a-6749b6060234 req-8bc10a09-7baf-4bb2-8e20-90feca665daf service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:16.870344 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-8b81f436-f89b-44cb-b16a-6749b6060234 req-8bc10a09-7baf-4bb2-8e20-90feca665daf service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:16.893389 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-8b81f436-f89b-44cb-b16a-6749b6060234 req-8bc10a09-7baf-4bb2-8e20-90feca665daf service nova] Creating event network-vif-deleted:3bb8fcc0-8e97-4a33-b4db-474a2d5f11ff for instance 4013c2da-f6fd-458b-860c-3683c05bc99d on hv-cinder-82204 Feb 08 17:30:16.905005 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-8b81f436-f89b-44cb-b16a-6749b6060234 req-8bc10a09-7baf-4bb2-8e20-90feca665daf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066924 Feb 08 17:30:16.906306 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 128/253] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:30:17.294085 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fecc61c0-85f6-4a86-8ca5-ba5487daaf56 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:17.296108 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-fecc61c0-85f6-4a86-8ca5-ba5487daaf56 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:17.310725 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fecc61c0-85f6-4a86-8ca5-ba5487daaf56 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:17.311625 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fecc61c0-85f6-4a86-8ca5-ba5487daaf56 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:17.312475 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fecc61c0-85f6-4a86-8ca5-ba5487daaf56 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:17.312916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fecc61c0-85f6-4a86-8ca5-ba5487daaf56 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:17.351932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7c5e5ab0-7a64-44cd-b958-fe44db310abb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:17.353312 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7c5e5ab0-7a64-44cd-b958-fe44db310abb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:17.384296 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7c5e5ab0-7a64-44cd-b958-fe44db310abb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:17.385491 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7c5e5ab0-7a64-44cd-b958-fe44db310abb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:17.387192 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7c5e5ab0-7a64-44cd-b958-fe44db310abb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:17.389608 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7c5e5ab0-7a64-44cd-b958-fe44db310abb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:17.700538 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-fecc61c0-85f6-4a86-8ca5-ba5487daaf56 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:17.716836 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-fecc61c0-85f6-4a86-8ca5-ba5487daaf56 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.433791 Feb 08 17:30:17.718334 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 126/254] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:17 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:17.872484 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6b2accf1-b6ac-4601-a31d-0a27dfd49b68 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:17.873686 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6b2accf1-b6ac-4601-a31d-0a27dfd49b68 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 4013c2da-f6fd-458b-860c-3683c05bc99d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:17.886783 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b2accf1-b6ac-4601-a31d-0a27dfd49b68 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:17.887881 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b2accf1-b6ac-4601-a31d-0a27dfd49b68 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:17.889516 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b2accf1-b6ac-4601-a31d-0a27dfd49b68 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:17.890041 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b2accf1-b6ac-4601-a31d-0a27dfd49b68 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:17.913111 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-6b2accf1-b6ac-4601-a31d-0a27dfd49b68 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] HTTP exception thrown: Instance 4013c2da-f6fd-458b-860c-3683c05bc99d could not be found. Feb 08 17:30:17.913803 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6b2accf1-b6ac-4601-a31d-0a27dfd49b68 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Returning 404 to user: Instance 4013c2da-f6fd-458b-860c-3683c05bc99d could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:30:17.915416 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6b2accf1-b6ac-4601-a31d-0a27dfd49b68 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d" status: 404 len: 111 microversion: 2.1 time: 0.047382 Feb 08 17:30:17.928110 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 127/255] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:17 2022] GET /compute/v2.1/servers/4013c2da-f6fd-458b-860c-3683c05bc99d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 17:30:17.962207 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-20e7accd-57b7-4cce-aab8-4a6cccc51835 req-b1f2ebcf-c569-4f58-aa84-6366be5fc3be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7282d48e-a1d2-4bb3-a4be-6692d6f27696", "tag": "9e760b09-df83-444f-a5a7-0d8b668f4627"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:17.970950 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:30:17.970950 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:30:17.995041 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-20e7accd-57b7-4cce-aab8-4a6cccc51835 req-b1f2ebcf-c569-4f58-aa84-6366be5fc3be service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:17.995793 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-20e7accd-57b7-4cce-aab8-4a6cccc51835 req-b1f2ebcf-c569-4f58-aa84-6366be5fc3be service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:18.006721 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-7c5e5ab0-7a64-44cd-b958-fe44db310abb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:18.032572 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7c5e5ab0-7a64-44cd-b958-fe44db310abb tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.685933 Feb 08 17:30:18.035146 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-20e7accd-57b7-4cce-aab8-4a6cccc51835 req-b1f2ebcf-c569-4f58-aa84-6366be5fc3be service nova] Creating event network-changed:9e760b09-df83-444f-a5a7-0d8b668f4627 for instance 7282d48e-a1d2-4bb3-a4be-6692d6f27696 on hv-cinder-82204 Feb 08 17:30:18.036877 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 129/256] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:17 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:18.061884 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-20e7accd-57b7-4cce-aab8-4a6cccc51835 req-b1f2ebcf-c569-4f58-aa84-6366be5fc3be service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121166 Feb 08 17:30:18.065364 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 128/257] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:30:18.152554 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2090851565", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "networks": [{"uuid": "c7086d13-3d57-4d17-8071-713a64bd1f29"}]}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:18.271067 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.network.neutron [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] validate_networks() for [('c7086d13-3d57-4d17-8071-713a64bd1f29', None, None, None, None, None)] {{(pid=116479) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:30:18.750574 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-05ab7034-7467-4de7-bf48-d9565bed5ce8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:18.752095 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-05ab7034-7467-4de7-bf48-d9565bed5ce8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:18.797475 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-05ab7034-7467-4de7-bf48-d9565bed5ce8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:18.799046 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-05ab7034-7467-4de7-bf48-d9565bed5ce8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:18.800053 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-05ab7034-7467-4de7-bf48-d9565bed5ce8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:18.801717 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-05ab7034-7467-4de7-bf48-d9565bed5ce8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:19.282647 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-05ab7034-7467-4de7-bf48-d9565bed5ce8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:19.335002 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-05ab7034-7467-4de7-bf48-d9565bed5ce8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.591312 Feb 08 17:30:19.339100 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 129/258] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:18 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:19.351283 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-23401d9c-2c1f-467d-856e-efe2011d5af0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:19.352592 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-23401d9c-2c1f-467d-856e-efe2011d5af0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:19.365566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-23401d9c-2c1f-467d-856e-efe2011d5af0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:19.367659 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-23401d9c-2c1f-467d-856e-efe2011d5af0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:19.369304 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-23401d9c-2c1f-467d-856e-efe2011d5af0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:19.370415 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-23401d9c-2c1f-467d-856e-efe2011d5af0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:19.850804 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-23401d9c-2c1f-467d-856e-efe2011d5af0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:19.893375 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-23401d9c-2c1f-467d-856e-efe2011d5af0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.550887 Feb 08 17:30:19.904187 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 130/259] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:19 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:20.077072 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Flavor limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:30:20.077868 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Image limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:30:20.078165 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Flavor pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:30:20.079459 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Image pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:30:20.080177 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:30:20.097930 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:20.098481 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:20.100526 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:20.101949 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:20.134933 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Getting quotas for project b57af0d0aa794073a318653dc7c14c5e. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:30:20.144596 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Getting quotas for user 9cd9d3aa05e94f08a96a479e292141ae and project b57af0d0aa794073a318653dc7c14c5e. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:30:20.174470 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Going to run 1 instances... {{(pid=116479) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:30:20.179237 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:30:20.263640 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8434f4a2-ab43-462f-92d3-4d4642668f70 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.117959 Feb 08 17:30:20.290052 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c0e59213-e721-446e-b7c5-f8b3fc74bf96 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:20.290789 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 130/260] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:30:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:30:20.291869 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c0e59213-e721-446e-b7c5-f8b3fc74bf96 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:20.367407 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-831ccf9d-8506-4282-87a8-8dd7df76e278 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:20.369074 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-831ccf9d-8506-4282-87a8-8dd7df76e278 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:20.385956 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-831ccf9d-8506-4282-87a8-8dd7df76e278 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:20.386300 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-831ccf9d-8506-4282-87a8-8dd7df76e278 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:20.387286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-831ccf9d-8506-4282-87a8-8dd7df76e278 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:20.387737 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-831ccf9d-8506-4282-87a8-8dd7df76e278 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:20.415756 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c0e59213-e721-446e-b7c5-f8b3fc74bf96 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:20.426316 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c0e59213-e721-446e-b7c5-f8b3fc74bf96 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1214 microversion: 2.1 time: 0.146737 Feb 08 17:30:20.437254 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 131/261] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:20 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:20.908146 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-831ccf9d-8506-4282-87a8-8dd7df76e278 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:20.923752 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-831ccf9d-8506-4282-87a8-8dd7df76e278 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.566439 Feb 08 17:30:20.925351 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 131/262] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:20 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:20.988347 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a888c628-8543-4c55-9bac-811014712b93 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:20.994498 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a888c628-8543-4c55-9bac-811014712b93 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:21.046832 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a888c628-8543-4c55-9bac-811014712b93 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:21.052873 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a888c628-8543-4c55-9bac-811014712b93 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:21.059917 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a888c628-8543-4c55-9bac-811014712b93 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:21.061136 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a888c628-8543-4c55-9bac-811014712b93 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:21.308267 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a888c628-8543-4c55-9bac-811014712b93 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:21.320790 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a888c628-8543-4c55-9bac-811014712b93 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.382955 Feb 08 17:30:21.321950 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 132/263] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:20 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:21.449573 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c7f28359-04dc-4bc5-8a7d-ce9f4099f276 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:21.450495 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c7f28359-04dc-4bc5-8a7d-ce9f4099f276 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:21.461405 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c7f28359-04dc-4bc5-8a7d-ce9f4099f276 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:21.462042 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c7f28359-04dc-4bc5-8a7d-ce9f4099f276 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:21.463409 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c7f28359-04dc-4bc5-8a7d-ce9f4099f276 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:21.464286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c7f28359-04dc-4bc5-8a7d-ce9f4099f276 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:21.568319 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-c7f28359-04dc-4bc5-8a7d-ce9f4099f276 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:21.580115 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c7f28359-04dc-4bc5-8a7d-ce9f4099f276 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1218 microversion: 2.1 time: 0.139054 Feb 08 17:30:21.580902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 132/264] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:21 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:21.949910 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3f6845ab-83d2-434d-80eb-3039bd899314 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:21.950632 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3f6845ab-83d2-434d-80eb-3039bd899314 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:21.958093 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3f6845ab-83d2-434d-80eb-3039bd899314 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:21.958629 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3f6845ab-83d2-434d-80eb-3039bd899314 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:21.959607 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3f6845ab-83d2-434d-80eb-3039bd899314 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:21.960044 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3f6845ab-83d2-434d-80eb-3039bd899314 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:22.152681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3f6845ab-83d2-434d-80eb-3039bd899314 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:22.168602 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3f6845ab-83d2-434d-80eb-3039bd899314 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.222579 Feb 08 17:30:22.174868 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 133/265] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:21 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:22.338820 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-02e0da18-9150-4c19-b7ee-9544c74de234 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:22.339642 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-02e0da18-9150-4c19-b7ee-9544c74de234 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:22.346973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02e0da18-9150-4c19-b7ee-9544c74de234 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:22.347641 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02e0da18-9150-4c19-b7ee-9544c74de234 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:22.348670 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02e0da18-9150-4c19-b7ee-9544c74de234 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:22.349335 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02e0da18-9150-4c19-b7ee-9544c74de234 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:22.559953 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-02e0da18-9150-4c19-b7ee-9544c74de234 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:22.568543 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-02e0da18-9150-4c19-b7ee-9544c74de234 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.233275 Feb 08 17:30:22.569021 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 133/266] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:22 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:22.606649 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d730bd09-533a-45bf-938f-2da74d1b2b12 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:22.607265 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d730bd09-533a-45bf-938f-2da74d1b2b12 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:22.613764 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d730bd09-533a-45bf-938f-2da74d1b2b12 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:22.614219 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d730bd09-533a-45bf-938f-2da74d1b2b12 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:22.615021 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d730bd09-533a-45bf-938f-2da74d1b2b12 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:22.615455 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d730bd09-533a-45bf-938f-2da74d1b2b12 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:22.717455 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d730bd09-533a-45bf-938f-2da74d1b2b12 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:22.727676 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d730bd09-533a-45bf-938f-2da74d1b2b12 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1218 microversion: 2.1 time: 0.124944 Feb 08 17:30:22.728252 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 134/267] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:22 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:23.191883 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-17e420f9-3ca4-49f2-9dea-2acc0feafda5 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:23.192497 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-17e420f9-3ca4-49f2-9dea-2acc0feafda5 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:23.199276 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17e420f9-3ca4-49f2-9dea-2acc0feafda5 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:23.199725 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17e420f9-3ca4-49f2-9dea-2acc0feafda5 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:23.200514 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17e420f9-3ca4-49f2-9dea-2acc0feafda5 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:23.200950 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17e420f9-3ca4-49f2-9dea-2acc0feafda5 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:23.362915 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-17e420f9-3ca4-49f2-9dea-2acc0feafda5 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:23.372451 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-17e420f9-3ca4-49f2-9dea-2acc0feafda5 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.184178 Feb 08 17:30:23.373431 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 134/268] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:23 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:23.591133 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3b08bdac-c294-44e1-a0aa-628d5214156c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:23.591133 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3b08bdac-c294-44e1-a0aa-628d5214156c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:23.599095 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b08bdac-c294-44e1-a0aa-628d5214156c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:23.599912 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b08bdac-c294-44e1-a0aa-628d5214156c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:23.602435 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b08bdac-c294-44e1-a0aa-628d5214156c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:23.603431 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b08bdac-c294-44e1-a0aa-628d5214156c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:23.750238 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ec9546dd-7f72-4679-9f9f-3791582aae73 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:23.753293 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ec9546dd-7f72-4679-9f9f-3791582aae73 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:23.775106 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ec9546dd-7f72-4679-9f9f-3791582aae73 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:23.775483 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ec9546dd-7f72-4679-9f9f-3791582aae73 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:23.779412 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ec9546dd-7f72-4679-9f9f-3791582aae73 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:23.780146 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ec9546dd-7f72-4679-9f9f-3791582aae73 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:23.906796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3b08bdac-c294-44e1-a0aa-628d5214156c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:23.921715 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3b08bdac-c294-44e1-a0aa-628d5214156c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.338606 Feb 08 17:30:23.922984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 135/269] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:23 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:23.952521 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ec9546dd-7f72-4679-9f9f-3791582aae73 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:23.964863 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ec9546dd-7f72-4679-9f9f-3791582aae73 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1266 microversion: 2.1 time: 0.220601 Feb 08 17:30:23.965944 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 135/270] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:23 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:24.401116 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f5fc1b42-d562-4123-a310-1d275ecbf538 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:24.408520 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f5fc1b42-d562-4123-a310-1d275ecbf538 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:24.421913 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f5fc1b42-d562-4123-a310-1d275ecbf538 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:24.423194 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f5fc1b42-d562-4123-a310-1d275ecbf538 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:24.425026 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f5fc1b42-d562-4123-a310-1d275ecbf538 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:24.426235 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f5fc1b42-d562-4123-a310-1d275ecbf538 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:24.687311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f5fc1b42-d562-4123-a310-1d275ecbf538 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:24.699510 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f5fc1b42-d562-4123-a310-1d275ecbf538 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.307240 Feb 08 17:30:24.700221 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 136/271] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:24 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:24.950511 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-213aba21-8ec7-4278-948d-8f0abd291836 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:24.951985 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-213aba21-8ec7-4278-948d-8f0abd291836 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:24.960208 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-213aba21-8ec7-4278-948d-8f0abd291836 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:24.960929 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-213aba21-8ec7-4278-948d-8f0abd291836 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:24.962069 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-213aba21-8ec7-4278-948d-8f0abd291836 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:24.962857 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-213aba21-8ec7-4278-948d-8f0abd291836 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:24.996355 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-125f1e1a-cdd0-40c2-891f-8047036e96fe tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:24.997556 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-125f1e1a-cdd0-40c2-891f-8047036e96fe tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:25.016575 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-125f1e1a-cdd0-40c2-891f-8047036e96fe tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:25.017214 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-125f1e1a-cdd0-40c2-891f-8047036e96fe tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:25.019102 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-125f1e1a-cdd0-40c2-891f-8047036e96fe tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:25.020249 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-125f1e1a-cdd0-40c2-891f-8047036e96fe tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:25.107203 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-125f1e1a-cdd0-40c2-891f-8047036e96fe tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:25.115550 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-125f1e1a-cdd0-40c2-891f-8047036e96fe tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1272 microversion: 2.1 time: 0.126300 Feb 08 17:30:25.117544 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 137/272] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:24 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:25.308161 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-213aba21-8ec7-4278-948d-8f0abd291836 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:25.320267 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-213aba21-8ec7-4278-948d-8f0abd291836 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.376720 Feb 08 17:30:25.320880 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 136/273] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:24 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:25.729408 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7114b04a-c789-454e-8bbb-d16d1a03c0a7 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:25.730522 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7114b04a-c789-454e-8bbb-d16d1a03c0a7 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:25.740870 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7114b04a-c789-454e-8bbb-d16d1a03c0a7 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:25.743405 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7114b04a-c789-454e-8bbb-d16d1a03c0a7 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:25.744875 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7114b04a-c789-454e-8bbb-d16d1a03c0a7 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:25.745719 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7114b04a-c789-454e-8bbb-d16d1a03c0a7 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:25.966052 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7114b04a-c789-454e-8bbb-d16d1a03c0a7 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:25.979954 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7114b04a-c789-454e-8bbb-d16d1a03c0a7 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.254084 Feb 08 17:30:25.980987 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 138/274] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:25 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:26.136453 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cfa174de-d06d-4a7d-8e21-9abf1cb92d03 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:26.137061 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-cfa174de-d06d-4a7d-8e21-9abf1cb92d03 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:26.144245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cfa174de-d06d-4a7d-8e21-9abf1cb92d03 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:26.144989 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cfa174de-d06d-4a7d-8e21-9abf1cb92d03 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:26.145637 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cfa174de-d06d-4a7d-8e21-9abf1cb92d03 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:26.146097 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cfa174de-d06d-4a7d-8e21-9abf1cb92d03 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:26.342552 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-92572299-0c2e-4f43-92c3-4433dfd34cc4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:26.343415 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-92572299-0c2e-4f43-92c3-4433dfd34cc4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:26.354843 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-92572299-0c2e-4f43-92c3-4433dfd34cc4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:26.356629 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-92572299-0c2e-4f43-92c3-4433dfd34cc4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:26.358033 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-92572299-0c2e-4f43-92c3-4433dfd34cc4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:26.358799 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-92572299-0c2e-4f43-92c3-4433dfd34cc4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:26.456177 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cfa174de-d06d-4a7d-8e21-9abf1cb92d03 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:26.481399 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cfa174de-d06d-4a7d-8e21-9abf1cb92d03 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.349026 Feb 08 17:30:26.483022 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 137/275] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:26 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:26.588461 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-92572299-0c2e-4f43-92c3-4433dfd34cc4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:26.612954 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-4fb767d0-da24-4ae6-88c9-b487fc97ce9c req-3ba35788-5ae8-404a-9a3d-57fdcb98480b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2199cab3-4787-4cf5-aae1-ca10c35a9a4d", "tag": "a16d3f1c-e76e-4cc4-b309-6b4ab737e4b3"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:26.619181 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-92572299-0c2e-4f43-92c3-4433dfd34cc4 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.284961 Feb 08 17:30:26.621568 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:30:26.621568 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:30:26.634158 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 139/276] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:26 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:26.637350 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-4fb767d0-da24-4ae6-88c9-b487fc97ce9c req-3ba35788-5ae8-404a-9a3d-57fdcb98480b service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:26.638124 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-4fb767d0-da24-4ae6-88c9-b487fc97ce9c req-3ba35788-5ae8-404a-9a3d-57fdcb98480b service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:26.655881 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-4fb767d0-da24-4ae6-88c9-b487fc97ce9c req-3ba35788-5ae8-404a-9a3d-57fdcb98480b service nova] Creating event network-changed:a16d3f1c-e76e-4cc4-b309-6b4ab737e4b3 for instance 2199cab3-4787-4cf5-aae1-ca10c35a9a4d on hv-cinder-82204 Feb 08 17:30:26.673778 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-4fb767d0-da24-4ae6-88c9-b487fc97ce9c req-3ba35788-5ae8-404a-9a3d-57fdcb98480b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074831 Feb 08 17:30:26.674771 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 138/277] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:30:26.997189 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3d166ea6-58dc-42eb-bffa-f8c2f174ba53 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:26.998000 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3d166ea6-58dc-42eb-bffa-f8c2f174ba53 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:27.013281 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3d166ea6-58dc-42eb-bffa-f8c2f174ba53 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:27.013808 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3d166ea6-58dc-42eb-bffa-f8c2f174ba53 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:27.016005 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3d166ea6-58dc-42eb-bffa-f8c2f174ba53 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:27.016601 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3d166ea6-58dc-42eb-bffa-f8c2f174ba53 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:27.289119 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3d166ea6-58dc-42eb-bffa-f8c2f174ba53 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:27.302500 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3d166ea6-58dc-42eb-bffa-f8c2f174ba53 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.309792 Feb 08 17:30:27.305650 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 140/278] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:26 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:27.505361 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-238df6c5-96bb-4b12-87e9-eccca0174526 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:27.509604 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-238df6c5-96bb-4b12-87e9-eccca0174526 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:27.514868 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-238df6c5-96bb-4b12-87e9-eccca0174526 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:27.515314 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-238df6c5-96bb-4b12-87e9-eccca0174526 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:27.516321 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-238df6c5-96bb-4b12-87e9-eccca0174526 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:27.516985 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-238df6c5-96bb-4b12-87e9-eccca0174526 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:27.645924 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f201a835-2ca6-4add-b2f3-a9dc08b06702 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:27.647148 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f201a835-2ca6-4add-b2f3-a9dc08b06702 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:27.658428 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f201a835-2ca6-4add-b2f3-a9dc08b06702 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:27.659646 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f201a835-2ca6-4add-b2f3-a9dc08b06702 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:27.663003 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f201a835-2ca6-4add-b2f3-a9dc08b06702 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:27.664056 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f201a835-2ca6-4add-b2f3-a9dc08b06702 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:27.918334 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-238df6c5-96bb-4b12-87e9-eccca0174526 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:27.933879 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-238df6c5-96bb-4b12-87e9-eccca0174526 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.435910 Feb 08 17:30:27.935648 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 139/279] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:27 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:27.937302 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f201a835-2ca6-4add-b2f3-a9dc08b06702 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:27.950130 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f201a835-2ca6-4add-b2f3-a9dc08b06702 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.312685 Feb 08 17:30:27.965327 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 141/280] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:27 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:28.328257 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-80b03f30-4475-4d2f-bd89-093a865b62e9 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:28.330580 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-80b03f30-4475-4d2f-bd89-093a865b62e9 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:28.362840 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-80b03f30-4475-4d2f-bd89-093a865b62e9 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:28.363252 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-80b03f30-4475-4d2f-bd89-093a865b62e9 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:28.364724 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-80b03f30-4475-4d2f-bd89-093a865b62e9 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:28.365585 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-80b03f30-4475-4d2f-bd89-093a865b62e9 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:28.653973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-80b03f30-4475-4d2f-bd89-093a865b62e9 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:28.678558 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-80b03f30-4475-4d2f-bd89-093a865b62e9 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.356837 Feb 08 17:30:28.679698 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 140/281] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:28 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:28.961972 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6f01b864-f99f-4d05-b0cd-7478cd914864 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:28.963147 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6f01b864-f99f-4d05-b0cd-7478cd914864 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:28.975488 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f01b864-f99f-4d05-b0cd-7478cd914864 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:28.976532 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f01b864-f99f-4d05-b0cd-7478cd914864 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:28.977126 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-96a538ec-7c7d-4406-ad19-378c8b1795d3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:28.977970 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-96a538ec-7c7d-4406-ad19-378c8b1795d3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:28.978140 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f01b864-f99f-4d05-b0cd-7478cd914864 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:28.978693 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f01b864-f99f-4d05-b0cd-7478cd914864 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:28.985519 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-96a538ec-7c7d-4406-ad19-378c8b1795d3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:28.986266 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-96a538ec-7c7d-4406-ad19-378c8b1795d3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:28.987290 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-96a538ec-7c7d-4406-ad19-378c8b1795d3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:28.987915 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-96a538ec-7c7d-4406-ad19-378c8b1795d3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:29.195605 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6f01b864-f99f-4d05-b0cd-7478cd914864 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:29.203487 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-96a538ec-7c7d-4406-ad19-378c8b1795d3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:29.210279 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6f01b864-f99f-4d05-b0cd-7478cd914864 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.255727 Feb 08 17:30:29.211278 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 142/282] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:28 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:29.222618 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-96a538ec-7c7d-4406-ad19-378c8b1795d3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.249640 Feb 08 17:30:29.226118 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 141/283] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:28 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:29.706491 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2b7b8266-82eb-4149-98ee-c774fb2deef4 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:29.706796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2b7b8266-82eb-4149-98ee-c774fb2deef4 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:29.717070 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b7b8266-82eb-4149-98ee-c774fb2deef4 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:29.718087 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b7b8266-82eb-4149-98ee-c774fb2deef4 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:29.720527 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b7b8266-82eb-4149-98ee-c774fb2deef4 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:29.721292 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b7b8266-82eb-4149-98ee-c774fb2deef4 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:29.969658 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2b7b8266-82eb-4149-98ee-c774fb2deef4 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:29.979757 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2b7b8266-82eb-4149-98ee-c774fb2deef4 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.281550 Feb 08 17:30:29.980500 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 143/284] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:29 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:30.236008 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d6565510-c4a3-41e8-847c-234a4899b175 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:30.237028 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d6565510-c4a3-41e8-847c-234a4899b175 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:30.247193 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d6565510-c4a3-41e8-847c-234a4899b175 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:30.248012 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-60ba3edc-5d98-465e-ad13-1ebbf25a8db5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:30.248245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d6565510-c4a3-41e8-847c-234a4899b175 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:30.248679 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-60ba3edc-5d98-465e-ad13-1ebbf25a8db5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:30.249732 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d6565510-c4a3-41e8-847c-234a4899b175 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:30.250622 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d6565510-c4a3-41e8-847c-234a4899b175 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:30.273954 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-60ba3edc-5d98-465e-ad13-1ebbf25a8db5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:30.273954 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-60ba3edc-5d98-465e-ad13-1ebbf25a8db5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:30.274406 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-60ba3edc-5d98-465e-ad13-1ebbf25a8db5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:30.275081 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-60ba3edc-5d98-465e-ad13-1ebbf25a8db5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:30.497852 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-60ba3edc-5d98-465e-ad13-1ebbf25a8db5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:30.499772 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d6565510-c4a3-41e8-847c-234a4899b175 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:30.512754 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-60ba3edc-5d98-465e-ad13-1ebbf25a8db5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.269627 Feb 08 17:30:30.513777 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 144/285] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:30 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:30.518371 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d6565510-c4a3-41e8-847c-234a4899b175 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.288260 Feb 08 17:30:30.519340 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 142/286] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:30 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:31.002315 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4f6eedba-8249-490f-bb07-faf51d22597d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:31.003544 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4f6eedba-8249-490f-bb07-faf51d22597d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:31.015699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4f6eedba-8249-490f-bb07-faf51d22597d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:31.016434 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4f6eedba-8249-490f-bb07-faf51d22597d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:31.018180 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4f6eedba-8249-490f-bb07-faf51d22597d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:31.019384 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4f6eedba-8249-490f-bb07-faf51d22597d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:31.305690 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4f6eedba-8249-490f-bb07-faf51d22597d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:31.320354 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4f6eedba-8249-490f-bb07-faf51d22597d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.324619 Feb 08 17:30:31.321619 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 145/287] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:30 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:31.539914 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b4eadac0-8268-4710-83d0-ef55502f9f1f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:31.541109 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b4eadac0-8268-4710-83d0-ef55502f9f1f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:31.547424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-583b7a1b-13f0-49a5-9d8e-2b470466090a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:31.548484 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-583b7a1b-13f0-49a5-9d8e-2b470466090a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:31.549898 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b4eadac0-8268-4710-83d0-ef55502f9f1f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:31.551424 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b4eadac0-8268-4710-83d0-ef55502f9f1f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:31.553255 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b4eadac0-8268-4710-83d0-ef55502f9f1f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:31.554104 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b4eadac0-8268-4710-83d0-ef55502f9f1f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:31.557793 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-583b7a1b-13f0-49a5-9d8e-2b470466090a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:31.558510 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-583b7a1b-13f0-49a5-9d8e-2b470466090a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:31.560200 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-583b7a1b-13f0-49a5-9d8e-2b470466090a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:31.561001 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-583b7a1b-13f0-49a5-9d8e-2b470466090a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:31.823535 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b4eadac0-8268-4710-83d0-ef55502f9f1f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:31.828184 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-583b7a1b-13f0-49a5-9d8e-2b470466090a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:31.833771 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b4eadac0-8268-4710-83d0-ef55502f9f1f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.301314 Feb 08 17:30:31.834992 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 143/288] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:31 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:31.843893 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-b9d346f7-7e77-420c-8196-3ad64abe8280 req-0da66c49-1d6e-419f-9349-2862d6441a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7282d48e-a1d2-4bb3-a4be-6692d6f27696", "name": "network-vif-plugged", "status": "completed", "tag": "9e760b09-df83-444f-a5a7-0d8b668f4627"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:31.845296 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:30:31.845296 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:30:31.848085 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-583b7a1b-13f0-49a5-9d8e-2b470466090a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.306314 Feb 08 17:30:31.848755 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 146/289] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:31 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:31.860035 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-b9d346f7-7e77-420c-8196-3ad64abe8280 req-0da66c49-1d6e-419f-9349-2862d6441a4b service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:31.860714 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-b9d346f7-7e77-420c-8196-3ad64abe8280 req-0da66c49-1d6e-419f-9349-2862d6441a4b service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:31.886541 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-b9d346f7-7e77-420c-8196-3ad64abe8280 req-0da66c49-1d6e-419f-9349-2862d6441a4b service nova] Creating event network-vif-plugged:9e760b09-df83-444f-a5a7-0d8b668f4627 for instance 7282d48e-a1d2-4bb3-a4be-6692d6f27696 on hv-cinder-82204 Feb 08 17:30:31.897220 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-b9d346f7-7e77-420c-8196-3ad64abe8280 req-0da66c49-1d6e-419f-9349-2862d6441a4b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059788 Feb 08 17:30:31.899324 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 144/290] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:30:32.347207 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d6bbf47d-7722-430a-90f3-ef3ac04846c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:32.348813 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d6bbf47d-7722-430a-90f3-ef3ac04846c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:32.358029 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d6bbf47d-7722-430a-90f3-ef3ac04846c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:32.358730 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d6bbf47d-7722-430a-90f3-ef3ac04846c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:32.360089 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d6bbf47d-7722-430a-90f3-ef3ac04846c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:32.360768 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d6bbf47d-7722-430a-90f3-ef3ac04846c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:32.620281 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d6bbf47d-7722-430a-90f3-ef3ac04846c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:32.637009 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d6bbf47d-7722-430a-90f3-ef3ac04846c8 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.296095 Feb 08 17:30:32.638186 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 147/291] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:32 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:32.859878 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ba8993e8-54b7-4f02-8b0e-a9070f719c3e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:32.868958 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ba8993e8-54b7-4f02-8b0e-a9070f719c3e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:32.871523 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-447e99e3-d573-4804-9885-3e136fbe8ca0 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:32.880897 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ba8993e8-54b7-4f02-8b0e-a9070f719c3e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:32.881901 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ba8993e8-54b7-4f02-8b0e-a9070f719c3e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:32.882873 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-447e99e3-d573-4804-9885-3e136fbe8ca0 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:32.883703 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ba8993e8-54b7-4f02-8b0e-a9070f719c3e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:32.884515 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ba8993e8-54b7-4f02-8b0e-a9070f719c3e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:32.894569 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-447e99e3-d573-4804-9885-3e136fbe8ca0 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:32.895365 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-447e99e3-d573-4804-9885-3e136fbe8ca0 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:32.904775 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-447e99e3-d573-4804-9885-3e136fbe8ca0 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:32.905986 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-447e99e3-d573-4804-9885-3e136fbe8ca0 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:33.159752 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ba8993e8-54b7-4f02-8b0e-a9070f719c3e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:33.168798 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ba8993e8-54b7-4f02-8b0e-a9070f719c3e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.318382 Feb 08 17:30:33.185199 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 145/292] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:32 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:33.185199 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bf87a19a-037a-419f-965f-7d3824115c15 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:33.185199 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-bf87a19a-037a-419f-965f-7d3824115c15 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:33.185816 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-447e99e3-d573-4804-9885-3e136fbe8ca0 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:33.186065 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf87a19a-037a-419f-965f-7d3824115c15 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:33.186707 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf87a19a-037a-419f-965f-7d3824115c15 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:33.188801 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-447e99e3-d573-4804-9885-3e136fbe8ca0 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.321985 Feb 08 17:30:33.189852 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf87a19a-037a-419f-965f-7d3824115c15 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:33.190309 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf87a19a-037a-419f-965f-7d3824115c15 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:33.190592 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 148/293] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:32 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:33.227573 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-bf87a19a-037a-419f-965f-7d3824115c15 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lazy-loading 'flavor' on Instance uuid c73f173b-bae7-44a2-b686-0179e64e9c30 {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:30:33.588130 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bf87a19a-037a-419f-965f-7d3824115c15 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "POST /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/action" status: 202 len: 0 microversion: 2.20 time: 0.416318 Feb 08 17:30:33.588820 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 146/294] 10.222.0.69 () {62 vars in 1318 bytes} [Tue Feb 8 17:30:33 2022] POST /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:30:33.602229 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f02788b8-82e0-4aab-9b2c-bccb078f3bec tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:33.602976 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f02788b8-82e0-4aab-9b2c-bccb078f3bec tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:33.609879 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f02788b8-82e0-4aab-9b2c-bccb078f3bec tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:33.610372 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f02788b8-82e0-4aab-9b2c-bccb078f3bec tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:33.611242 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f02788b8-82e0-4aab-9b2c-bccb078f3bec tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:33.611706 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f02788b8-82e0-4aab-9b2c-bccb078f3bec tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:33.662877 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c537bce1-962e-4cb1-914a-4496b42303be tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:33.663896 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c537bce1-962e-4cb1-914a-4496b42303be tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:33.671753 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c537bce1-962e-4cb1-914a-4496b42303be tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:33.672207 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c537bce1-962e-4cb1-914a-4496b42303be tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:33.674897 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c537bce1-962e-4cb1-914a-4496b42303be tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:33.674897 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c537bce1-962e-4cb1-914a-4496b42303be tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:33.787976 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f02788b8-82e0-4aab-9b2c-bccb078f3bec tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:33.803778 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f02788b8-82e0-4aab-9b2c-bccb078f3bec tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:33.806467 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f02788b8-82e0-4aab-9b2c-bccb078f3bec tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:33.808597 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f02788b8-82e0-4aab-9b2c-bccb078f3bec tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.210601 Feb 08 17:30:33.809583 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 149/295] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:33 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:33.888242 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-c537bce1-962e-4cb1-914a-4496b42303be tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:33.896227 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c537bce1-962e-4cb1-914a-4496b42303be tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.238434 Feb 08 17:30:33.897628 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 147/296] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:33 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:34.199274 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ce7f9090-89d1-42b2-b4d4-77d22cda0c31 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:34.200163 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ce7f9090-89d1-42b2-b4d4-77d22cda0c31 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:34.210462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ce7f9090-89d1-42b2-b4d4-77d22cda0c31 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:34.211253 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ce7f9090-89d1-42b2-b4d4-77d22cda0c31 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:34.212696 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ce7f9090-89d1-42b2-b4d4-77d22cda0c31 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:34.213098 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0ceb952c-6e02-4a39-b5b0-ff144e6118be tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:34.213489 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ce7f9090-89d1-42b2-b4d4-77d22cda0c31 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:34.214281 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0ceb952c-6e02-4a39-b5b0-ff144e6118be tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:34.222818 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0ceb952c-6e02-4a39-b5b0-ff144e6118be tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:34.223536 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0ceb952c-6e02-4a39-b5b0-ff144e6118be tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:34.224879 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0ceb952c-6e02-4a39-b5b0-ff144e6118be tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:34.225641 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0ceb952c-6e02-4a39-b5b0-ff144e6118be tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:34.434558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ce7f9090-89d1-42b2-b4d4-77d22cda0c31 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:34.444954 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ce7f9090-89d1-42b2-b4d4-77d22cda0c31 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.251912 Feb 08 17:30:34.446282 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 150/297] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:34 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:34.459455 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0ceb952c-6e02-4a39-b5b0-ff144e6118be tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:34.471901 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0ceb952c-6e02-4a39-b5b0-ff144e6118be tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.262961 Feb 08 17:30:34.473049 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 148/298] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:34 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:34.834382 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e2b6e647-8a57-4ca1-a523-3af7d2b84bc6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:34.835351 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e2b6e647-8a57-4ca1-a523-3af7d2b84bc6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:34.845985 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e2b6e647-8a57-4ca1-a523-3af7d2b84bc6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:34.846711 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e2b6e647-8a57-4ca1-a523-3af7d2b84bc6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:34.848074 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e2b6e647-8a57-4ca1-a523-3af7d2b84bc6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:34.848795 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e2b6e647-8a57-4ca1-a523-3af7d2b84bc6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:34.923057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-dc31b196-105e-49c0-bf45-e70f5c145d7d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:34.923930 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-dc31b196-105e-49c0-bf45-e70f5c145d7d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:34.939567 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc31b196-105e-49c0-bf45-e70f5c145d7d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:34.940355 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc31b196-105e-49c0-bf45-e70f5c145d7d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:34.942257 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc31b196-105e-49c0-bf45-e70f5c145d7d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:34.943070 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc31b196-105e-49c0-bf45-e70f5c145d7d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:35.092666 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e2b6e647-8a57-4ca1-a523-3af7d2b84bc6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:35.117150 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e2b6e647-8a57-4ca1-a523-3af7d2b84bc6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:35.119102 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e2b6e647-8a57-4ca1-a523-3af7d2b84bc6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:35.121254 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e2b6e647-8a57-4ca1-a523-3af7d2b84bc6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.292785 Feb 08 17:30:35.121254 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 151/299] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:34 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:35.227638 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-dc31b196-105e-49c0-bf45-e70f5c145d7d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:35.241687 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-dc31b196-105e-49c0-bf45-e70f5c145d7d tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.323012 Feb 08 17:30:35.243567 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 149/300] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:34 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:35.465845 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-294f11f4-9cfe-406d-9225-7e177a06c598 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:35.468302 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-294f11f4-9cfe-406d-9225-7e177a06c598 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:35.474850 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-294f11f4-9cfe-406d-9225-7e177a06c598 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:35.475270 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-294f11f4-9cfe-406d-9225-7e177a06c598 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:35.476210 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-294f11f4-9cfe-406d-9225-7e177a06c598 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:35.477547 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-294f11f4-9cfe-406d-9225-7e177a06c598 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:35.497007 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-649b8365-fc8d-4582-9c65-52982ed8e070 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:35.500436 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-649b8365-fc8d-4582-9c65-52982ed8e070 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:35.511235 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-649b8365-fc8d-4582-9c65-52982ed8e070 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:35.512194 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-649b8365-fc8d-4582-9c65-52982ed8e070 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:35.513417 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-649b8365-fc8d-4582-9c65-52982ed8e070 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:35.514496 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-649b8365-fc8d-4582-9c65-52982ed8e070 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:35.707071 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-294f11f4-9cfe-406d-9225-7e177a06c598 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:35.720730 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-294f11f4-9cfe-406d-9225-7e177a06c598 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.258790 Feb 08 17:30:35.722259 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 152/301] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:35 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:35.763628 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-649b8365-fc8d-4582-9c65-52982ed8e070 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:35.776021 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-649b8365-fc8d-4582-9c65-52982ed8e070 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.286115 Feb 08 17:30:35.776787 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 150/302] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:35 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:36.158490 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ffac8d5c-09be-4c25-b947-a6e60f0cc844 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:36.159466 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ffac8d5c-09be-4c25-b947-a6e60f0cc844 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:36.169101 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ffac8d5c-09be-4c25-b947-a6e60f0cc844 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:36.169796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ffac8d5c-09be-4c25-b947-a6e60f0cc844 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:36.170969 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ffac8d5c-09be-4c25-b947-a6e60f0cc844 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:36.171808 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ffac8d5c-09be-4c25-b947-a6e60f0cc844 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:36.280122 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-aac5e533-29d7-48e9-bc03-6cb64672b128 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:36.286620 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-aac5e533-29d7-48e9-bc03-6cb64672b128 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:36.323352 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-aac5e533-29d7-48e9-bc03-6cb64672b128 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:36.325722 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-aac5e533-29d7-48e9-bc03-6cb64672b128 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:36.327722 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-aac5e533-29d7-48e9-bc03-6cb64672b128 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:36.329323 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-aac5e533-29d7-48e9-bc03-6cb64672b128 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:36.462475 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ffac8d5c-09be-4c25-b947-a6e60f0cc844 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:36.482426 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ffac8d5c-09be-4c25-b947-a6e60f0cc844 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:36.485315 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ffac8d5c-09be-4c25-b947-a6e60f0cc844 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:36.487599 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ffac8d5c-09be-4c25-b947-a6e60f0cc844 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.335800 Feb 08 17:30:36.489411 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 153/303] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:36 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:36.600986 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-aac5e533-29d7-48e9-bc03-6cb64672b128 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:36.619287 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-aac5e533-29d7-48e9-bc03-6cb64672b128 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.357147 Feb 08 17:30:36.620269 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 151/304] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:36 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:36.747917 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-473039e9-5823-48ec-bab7-f8c3f63b98d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:36.748826 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-473039e9-5823-48ec-bab7-f8c3f63b98d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:36.759681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-473039e9-5823-48ec-bab7-f8c3f63b98d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:36.760397 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-473039e9-5823-48ec-bab7-f8c3f63b98d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:36.765473 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-473039e9-5823-48ec-bab7-f8c3f63b98d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:36.765473 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-473039e9-5823-48ec-bab7-f8c3f63b98d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:36.804930 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ea55da39-1f93-4ed8-82dd-d455d9212981 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:36.806173 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ea55da39-1f93-4ed8-82dd-d455d9212981 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:36.821251 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ea55da39-1f93-4ed8-82dd-d455d9212981 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:36.821969 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ea55da39-1f93-4ed8-82dd-d455d9212981 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:36.823200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ea55da39-1f93-4ed8-82dd-d455d9212981 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:36.823893 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ea55da39-1f93-4ed8-82dd-d455d9212981 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:37.026915 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-473039e9-5823-48ec-bab7-f8c3f63b98d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:37.047963 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-473039e9-5823-48ec-bab7-f8c3f63b98d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.306460 Feb 08 17:30:37.048903 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 154/305] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:36 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:37.130474 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ea55da39-1f93-4ed8-82dd-d455d9212981 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:37.162342 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ea55da39-1f93-4ed8-82dd-d455d9212981 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.360385 Feb 08 17:30:37.163722 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 152/306] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:36 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:37.522695 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5b6d5c6d-db3b-498d-bd51-3db0b4f628d9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:37.524084 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5b6d5c6d-db3b-498d-bd51-3db0b4f628d9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:37.534050 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5b6d5c6d-db3b-498d-bd51-3db0b4f628d9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:37.534824 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5b6d5c6d-db3b-498d-bd51-3db0b4f628d9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:37.536179 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5b6d5c6d-db3b-498d-bd51-3db0b4f628d9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:37.536871 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5b6d5c6d-db3b-498d-bd51-3db0b4f628d9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:37.644953 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-103456b8-dab8-4f97-9cf0-9aeead2866fc tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:37.650213 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-103456b8-dab8-4f97-9cf0-9aeead2866fc tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:37.663347 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-103456b8-dab8-4f97-9cf0-9aeead2866fc tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:37.664047 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-103456b8-dab8-4f97-9cf0-9aeead2866fc tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:37.665139 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-103456b8-dab8-4f97-9cf0-9aeead2866fc tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:37.665924 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-103456b8-dab8-4f97-9cf0-9aeead2866fc tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:37.797320 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5b6d5c6d-db3b-498d-bd51-3db0b4f628d9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:37.812410 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5b6d5c6d-db3b-498d-bd51-3db0b4f628d9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:37.814916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5b6d5c6d-db3b-498d-bd51-3db0b4f628d9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:37.817575 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5b6d5c6d-db3b-498d-bd51-3db0b4f628d9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.301073 Feb 08 17:30:37.821360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 155/307] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:37 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:37.899350 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-103456b8-dab8-4f97-9cf0-9aeead2866fc tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:37.911366 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-103456b8-dab8-4f97-9cf0-9aeead2866fc tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.271275 Feb 08 17:30:37.911966 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 153/308] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:37 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:38.079469 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e15fc869-7945-4383-bbba-c25a28fb9d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:38.080156 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e15fc869-7945-4383-bbba-c25a28fb9d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:38.090218 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e15fc869-7945-4383-bbba-c25a28fb9d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:38.091272 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e15fc869-7945-4383-bbba-c25a28fb9d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:38.092274 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e15fc869-7945-4383-bbba-c25a28fb9d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:38.093361 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e15fc869-7945-4383-bbba-c25a28fb9d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:38.190799 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-02aada59-e94f-45b3-b44f-02520c7d339c tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:38.191230 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-02aada59-e94f-45b3-b44f-02520c7d339c tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:38.198663 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02aada59-e94f-45b3-b44f-02520c7d339c tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:38.199308 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02aada59-e94f-45b3-b44f-02520c7d339c tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:38.200279 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02aada59-e94f-45b3-b44f-02520c7d339c tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:38.200845 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02aada59-e94f-45b3-b44f-02520c7d339c tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:38.304069 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e15fc869-7945-4383-bbba-c25a28fb9d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:38.317374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e15fc869-7945-4383-bbba-c25a28fb9d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.242685 Feb 08 17:30:38.318906 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 156/309] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:38 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:38.437292 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-02aada59-e94f-45b3-b44f-02520c7d339c tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:38.446266 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-02aada59-e94f-45b3-b44f-02520c7d339c tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.261563 Feb 08 17:30:38.447028 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 154/310] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:38 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:38.845633 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-79615d21-b1f4-4469-a2d7-6df61d73891f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:38.846649 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-79615d21-b1f4-4469-a2d7-6df61d73891f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:38.856340 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79615d21-b1f4-4469-a2d7-6df61d73891f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:38.857048 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79615d21-b1f4-4469-a2d7-6df61d73891f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:38.858826 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79615d21-b1f4-4469-a2d7-6df61d73891f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:38.859029 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79615d21-b1f4-4469-a2d7-6df61d73891f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:38.932000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ba83b455-3a84-4516-8891-142943e6f516 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:38.933882 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ba83b455-3a84-4516-8891-142943e6f516 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:38.944078 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ba83b455-3a84-4516-8891-142943e6f516 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:38.944659 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ba83b455-3a84-4516-8891-142943e6f516 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:38.946444 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ba83b455-3a84-4516-8891-142943e6f516 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:38.947055 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ba83b455-3a84-4516-8891-142943e6f516 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:39.068519 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-79615d21-b1f4-4469-a2d7-6df61d73891f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:39.088181 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-79615d21-b1f4-4469-a2d7-6df61d73891f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:39.089808 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-79615d21-b1f4-4469-a2d7-6df61d73891f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:39.091005 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-79615d21-b1f4-4469-a2d7-6df61d73891f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.249619 Feb 08 17:30:39.091975 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 157/311] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:38 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:30:39.145605 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ba83b455-3a84-4516-8891-142943e6f516 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:39.157900 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ba83b455-3a84-4516-8891-142943e6f516 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.231170 Feb 08 17:30:39.158540 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 155/312] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:38 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:39.346280 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-28472bd0-2f1a-4bc4-a563-702dd33560f5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:39.348807 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-28472bd0-2f1a-4bc4-a563-702dd33560f5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:39.360353 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-28472bd0-2f1a-4bc4-a563-702dd33560f5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:39.360984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-28472bd0-2f1a-4bc4-a563-702dd33560f5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:39.363905 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-28472bd0-2f1a-4bc4-a563-702dd33560f5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:39.363905 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-28472bd0-2f1a-4bc4-a563-702dd33560f5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:39.466131 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8fb7d536-f413-40ac-94fb-bb1dc608defd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:39.467894 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8fb7d536-f413-40ac-94fb-bb1dc608defd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:39.477303 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8fb7d536-f413-40ac-94fb-bb1dc608defd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:39.477988 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8fb7d536-f413-40ac-94fb-bb1dc608defd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:39.478819 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8fb7d536-f413-40ac-94fb-bb1dc608defd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:39.479275 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8fb7d536-f413-40ac-94fb-bb1dc608defd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:39.614219 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-28472bd0-2f1a-4bc4-a563-702dd33560f5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:39.631951 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-28472bd0-2f1a-4bc4-a563-702dd33560f5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.293827 Feb 08 17:30:39.634553 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 158/313] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:39 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:39.729800 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8fb7d536-f413-40ac-94fb-bb1dc608defd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:39.740348 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8fb7d536-f413-40ac-94fb-bb1dc608defd tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.280378 Feb 08 17:30:39.741186 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 156/314] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:39 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:40.111723 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7e43fa92-e6ea-441b-a259-27e71f19c68e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:40.112326 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7e43fa92-e6ea-441b-a259-27e71f19c68e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:40.120433 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7e43fa92-e6ea-441b-a259-27e71f19c68e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:40.121029 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7e43fa92-e6ea-441b-a259-27e71f19c68e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:40.122024 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7e43fa92-e6ea-441b-a259-27e71f19c68e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:40.122562 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7e43fa92-e6ea-441b-a259-27e71f19c68e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:40.176162 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-05b16a37-b649-4943-b0ab-203a86875a5c tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:40.176911 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-05b16a37-b649-4943-b0ab-203a86875a5c tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:40.183487 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-05b16a37-b649-4943-b0ab-203a86875a5c tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:40.183950 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-05b16a37-b649-4943-b0ab-203a86875a5c tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:40.185297 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-05b16a37-b649-4943-b0ab-203a86875a5c tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:40.185297 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-05b16a37-b649-4943-b0ab-203a86875a5c tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:40.308398 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7e43fa92-e6ea-441b-a259-27e71f19c68e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:40.325322 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7e43fa92-e6ea-441b-a259-27e71f19c68e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:40.329845 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7e43fa92-e6ea-441b-a259-27e71f19c68e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:40.332299 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7e43fa92-e6ea-441b-a259-27e71f19c68e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.223900 Feb 08 17:30:40.333642 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 159/315] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:40 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:40.668680 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3709ec31-f878-417f-99d7-5d2261eaaf76 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:40.669769 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3709ec31-f878-417f-99d7-5d2261eaaf76 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:40.680515 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3709ec31-f878-417f-99d7-5d2261eaaf76 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:40.681693 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3709ec31-f878-417f-99d7-5d2261eaaf76 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:40.683418 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3709ec31-f878-417f-99d7-5d2261eaaf76 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:40.684128 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3709ec31-f878-417f-99d7-5d2261eaaf76 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:40.729473 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-05b16a37-b649-4943-b0ab-203a86875a5c tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:40.745932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-05b16a37-b649-4943-b0ab-203a86875a5c tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1313 microversion: 2.1 time: 0.572986 Feb 08 17:30:40.747624 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 157/316] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:40 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:40.775390 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-59de98a8-1bd0-4ea6-8307-af95bcfb327f tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:40.776643 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-59de98a8-1bd0-4ea6-8307-af95bcfb327f tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:40.787843 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59de98a8-1bd0-4ea6-8307-af95bcfb327f tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:40.788704 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59de98a8-1bd0-4ea6-8307-af95bcfb327f tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:40.790832 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59de98a8-1bd0-4ea6-8307-af95bcfb327f tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:40.792117 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59de98a8-1bd0-4ea6-8307-af95bcfb327f tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:40.976691 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3709ec31-f878-417f-99d7-5d2261eaaf76 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:40.993690 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3709ec31-f878-417f-99d7-5d2261eaaf76 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.332411 Feb 08 17:30:41.009198 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 160/317] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:40 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:41.071988 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-59de98a8-1bd0-4ea6-8307-af95bcfb327f tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:41.086558 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-59de98a8-1bd0-4ea6-8307-af95bcfb327f tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.315934 Feb 08 17:30:41.087741 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 158/318] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:40 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:41.362729 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-be881d07-b8df-4f01-aa4c-c2b34c774ff3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:41.363853 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-be881d07-b8df-4f01-aa4c-c2b34c774ff3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:41.378503 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be881d07-b8df-4f01-aa4c-c2b34c774ff3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:41.378926 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be881d07-b8df-4f01-aa4c-c2b34c774ff3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:41.379873 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be881d07-b8df-4f01-aa4c-c2b34c774ff3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:41.380316 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be881d07-b8df-4f01-aa4c-c2b34c774ff3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:41.600996 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-be881d07-b8df-4f01-aa4c-c2b34c774ff3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:41.618332 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-be881d07-b8df-4f01-aa4c-c2b34c774ff3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:41.621471 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-be881d07-b8df-4f01-aa4c-c2b34c774ff3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:41.623836 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-be881d07-b8df-4f01-aa4c-c2b34c774ff3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.268658 Feb 08 17:30:41.625043 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 161/319] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:41 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:41.781223 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-060e0b66-e5d4-47e9-8581-80ab2d449a7b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:41.782652 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-060e0b66-e5d4-47e9-8581-80ab2d449a7b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:41.792856 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-060e0b66-e5d4-47e9-8581-80ab2d449a7b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:41.794093 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-060e0b66-e5d4-47e9-8581-80ab2d449a7b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:41.795530 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-060e0b66-e5d4-47e9-8581-80ab2d449a7b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:41.796308 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-060e0b66-e5d4-47e9-8581-80ab2d449a7b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:42.040265 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-047f764f-7df0-4b91-bf24-efe409bcb4b8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:42.041335 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-047f764f-7df0-4b91-bf24-efe409bcb4b8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:42.067479 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-047f764f-7df0-4b91-bf24-efe409bcb4b8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:42.068467 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-047f764f-7df0-4b91-bf24-efe409bcb4b8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:42.070868 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-047f764f-7df0-4b91-bf24-efe409bcb4b8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:42.073464 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-047f764f-7df0-4b91-bf24-efe409bcb4b8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:42.096184 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-060e0b66-e5d4-47e9-8581-80ab2d449a7b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:42.131000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-060e0b66-e5d4-47e9-8581-80ab2d449a7b tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1462 microversion: 2.1 time: 0.357072 Feb 08 17:30:42.140851 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 159/320] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:41 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1462 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:42.166788 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1928b496-978e-470f-8248-77a33108428a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:42.167874 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1928b496-978e-470f-8248-77a33108428a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:42.186420 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1928b496-978e-470f-8248-77a33108428a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:42.191513 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1928b496-978e-470f-8248-77a33108428a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:42.193747 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1928b496-978e-470f-8248-77a33108428a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:42.199432 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1928b496-978e-470f-8248-77a33108428a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:42.672335 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-047f764f-7df0-4b91-bf24-efe409bcb4b8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:42.690740 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-047f764f-7df0-4b91-bf24-efe409bcb4b8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.659742 Feb 08 17:30:42.693078 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 162/321] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:42 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:42.703848 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5b1d0419-ee45-4085-8079-4eaf08cb000d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:42.706336 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5b1d0419-ee45-4085-8079-4eaf08cb000d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:42.740358 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5b1d0419-ee45-4085-8079-4eaf08cb000d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:42.742070 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5b1d0419-ee45-4085-8079-4eaf08cb000d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:42.744732 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5b1d0419-ee45-4085-8079-4eaf08cb000d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:42.747276 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5b1d0419-ee45-4085-8079-4eaf08cb000d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:42.902458 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1928b496-978e-470f-8248-77a33108428a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:42.928371 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1928b496-978e-470f-8248-77a33108428a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.783566 Feb 08 17:30:42.930291 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 160/322] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:42 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:43.006684 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b17d14ec-7dab-4319-aad9-2ba3cb59d0e6 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:43.007277 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b17d14ec-7dab-4319-aad9-2ba3cb59d0e6 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:43.048377 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b17d14ec-7dab-4319-aad9-2ba3cb59d0e6 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:43.058410 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b17d14ec-7dab-4319-aad9-2ba3cb59d0e6 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:43.058410 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b17d14ec-7dab-4319-aad9-2ba3cb59d0e6 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:43.058410 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b17d14ec-7dab-4319-aad9-2ba3cb59d0e6 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:43.180432 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b17d14ec-7dab-4319-aad9-2ba3cb59d0e6 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Going to try to terminate instance {{(pid=116479) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:30:43.329901 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5b1d0419-ee45-4085-8079-4eaf08cb000d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:43.369713 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5b1d0419-ee45-4085-8079-4eaf08cb000d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:43.373761 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5b1d0419-ee45-4085-8079-4eaf08cb000d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:43.386456 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5b1d0419-ee45-4085-8079-4eaf08cb000d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.686213 Feb 08 17:30:43.424296 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 163/323] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:42 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:43.453829 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-9ceb2f6b-3998-47cb-8c45-263fff443c08 req-60efb9a3-b7ee-4412-bcbe-39aef420e191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2199cab3-4787-4cf5-aae1-ca10c35a9a4d", "name": "network-vif-plugged", "status": "completed", "tag": "a16d3f1c-e76e-4cc4-b309-6b4ab737e4b3"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:43.455656 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:30:43.455656 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:30:43.496373 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b17d14ec-7dab-4319-aad9-2ba3cb59d0e6 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 204 len: 0 microversion: 2.1 time: 0.489656 Feb 08 17:30:43.499326 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-9ceb2f6b-3998-47cb-8c45-263fff443c08 req-60efb9a3-b7ee-4412-bcbe-39aef420e191 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:43.501838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-9ceb2f6b-3998-47cb-8c45-263fff443c08 req-60efb9a3-b7ee-4412-bcbe-39aef420e191 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:43.510313 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 161/324] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:30:42 2022] DELETE /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 08 17:30:43.521870 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2f8681cd-e863-4860-9238-f5f74e858881 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:43.522962 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2f8681cd-e863-4860-9238-f5f74e858881 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:43.532344 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-9ceb2f6b-3998-47cb-8c45-263fff443c08 req-60efb9a3-b7ee-4412-bcbe-39aef420e191 service nova] Creating event network-vif-plugged:a16d3f1c-e76e-4cc4-b309-6b4ab737e4b3 for instance 2199cab3-4787-4cf5-aae1-ca10c35a9a4d on hv-cinder-82204 Feb 08 17:30:43.535710 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2f8681cd-e863-4860-9238-f5f74e858881 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:43.536458 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2f8681cd-e863-4860-9238-f5f74e858881 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:43.537795 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2f8681cd-e863-4860-9238-f5f74e858881 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:43.541109 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2f8681cd-e863-4860-9238-f5f74e858881 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:43.553671 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-9ceb2f6b-3998-47cb-8c45-263fff443c08 req-60efb9a3-b7ee-4412-bcbe-39aef420e191 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118599 Feb 08 17:30:43.554694 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 164/325] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:30:43.734590 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-aaa4fc13-1514-4c86-b9d9-bb9336d3424c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:43.739110 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-aaa4fc13-1514-4c86-b9d9-bb9336d3424c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:43.750173 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aaa4fc13-1514-4c86-b9d9-bb9336d3424c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:43.750720 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aaa4fc13-1514-4c86-b9d9-bb9336d3424c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:43.751755 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aaa4fc13-1514-4c86-b9d9-bb9336d3424c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:43.752371 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aaa4fc13-1514-4c86-b9d9-bb9336d3424c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:43.957501 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2f8681cd-e863-4860-9238-f5f74e858881 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:43.976373 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2f8681cd-e863-4860-9238-f5f74e858881 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1468 microversion: 2.1 time: 0.453681 Feb 08 17:30:43.978077 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 162/326] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:43 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1468 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:44.017286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0f171cc5-d43a-42a1-b00a-a85990a30c46 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:44.017535 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0f171cc5-d43a-42a1-b00a-a85990a30c46 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:44.048660 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0f171cc5-d43a-42a1-b00a-a85990a30c46 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.053995 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0f171cc5-d43a-42a1-b00a-a85990a30c46 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:44.061078 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0f171cc5-d43a-42a1-b00a-a85990a30c46 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.062026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0f171cc5-d43a-42a1-b00a-a85990a30c46 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:44.152047 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-aaa4fc13-1514-4c86-b9d9-bb9336d3424c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:44.177509 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-aaa4fc13-1514-4c86-b9d9-bb9336d3424c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1501 microversion: 2.1 time: 0.455833 Feb 08 17:30:44.177509 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 165/327] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:43 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1501 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:44.214757 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-62be568d-d885-4989-9bcb-8dc1ce4bd70c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "762ffcbf-c98f-4eca-b373-cb1a8533be4d"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:44.220835 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-62be568d-d885-4989-9bcb-8dc1ce4bd70c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:44.239886 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-62be568d-d885-4989-9bcb-8dc1ce4bd70c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.241077 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-62be568d-d885-4989-9bcb-8dc1ce4bd70c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:44.252991 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-62be568d-d885-4989-9bcb-8dc1ce4bd70c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.254235 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-62be568d-d885-4989-9bcb-8dc1ce4bd70c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:44.303290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-62be568d-d885-4989-9bcb-8dc1ce4bd70c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] HTTP exception thrown: Cannot 'attach_volume' instance 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 while it is in vm_state rescued Feb 08 17:30:44.303959 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-62be568d-d885-4989-9bcb-8dc1ce4bd70c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Returning 409 to user: Cannot 'attach_volume' instance 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 while it is in vm_state rescued {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:30:44.305595 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-62be568d-d885-4989-9bcb-8dc1ce4bd70c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.103192 Feb 08 17:30:44.306405 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 166/328] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:30:44 2022] POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 08 17:30:44.319375 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2c4f70bb-f8da-442d-9682-a95a657c4b57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:44.320111 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2c4f70bb-f8da-442d-9682-a95a657c4b57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:44.330055 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2c4f70bb-f8da-442d-9682-a95a657c4b57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.330592 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2c4f70bb-f8da-442d-9682-a95a657c4b57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:44.331696 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2c4f70bb-f8da-442d-9682-a95a657c4b57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.332596 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2c4f70bb-f8da-442d-9682-a95a657c4b57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:44.372817 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0f171cc5-d43a-42a1-b00a-a85990a30c46 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:44.396122 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0f171cc5-d43a-42a1-b00a-a85990a30c46 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.413782 Feb 08 17:30:44.397340 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 163/329] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:43 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:44.406165 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c3551614-6b5b-4c1a-aacd-e2fa0e2c53c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ced998de-d26d-49b9-8cbd-c0edaabd635c"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:44.408490 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c3551614-6b5b-4c1a-aacd-e2fa0e2c53c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:44.419221 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c3551614-6b5b-4c1a-aacd-e2fa0e2c53c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.420056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c3551614-6b5b-4c1a-aacd-e2fa0e2c53c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:44.421526 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c3551614-6b5b-4c1a-aacd-e2fa0e2c53c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.422418 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c3551614-6b5b-4c1a-aacd-e2fa0e2c53c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:44.451843 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2c4f70bb-f8da-442d-9682-a95a657c4b57 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/action" status: 202 len: 0 microversion: 2.1 time: 0.137796 Feb 08 17:30:44.458899 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 167/330] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:30:44 2022] POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:30:44.469930 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-17eb5344-a245-489c-99b2-2c2a50b63bd1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:44.471830 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-17eb5344-a245-489c-99b2-2c2a50b63bd1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:44.483514 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-17eb5344-a245-489c-99b2-2c2a50b63bd1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.485021 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-17eb5344-a245-489c-99b2-2c2a50b63bd1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:44.486866 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-17eb5344-a245-489c-99b2-2c2a50b63bd1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.487914 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-17eb5344-a245-489c-99b2-2c2a50b63bd1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:44.939059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-17eb5344-a245-489c-99b2-2c2a50b63bd1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:44.948715 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-17eb5344-a245-489c-99b2-2c2a50b63bd1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:44.952233 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-17eb5344-a245-489c-99b2-2c2a50b63bd1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:44.953892 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-17eb5344-a245-489c-99b2-2c2a50b63bd1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.492906 Feb 08 17:30:44.954799 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 168/331] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:44 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:44.961558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4e91a9df-21e1-4d6e-a721-041a7809d72c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:44.962643 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4e91a9df-21e1-4d6e-a721-041a7809d72c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:44.973286 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4e91a9df-21e1-4d6e-a721-041a7809d72c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.974797 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4e91a9df-21e1-4d6e-a721-041a7809d72c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:44.976422 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4e91a9df-21e1-4d6e-a721-041a7809d72c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:44.978071 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4e91a9df-21e1-4d6e-a721-041a7809d72c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:45.347108 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c3551614-6b5b-4c1a-aacd-e2fa0e2c53c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "POST /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945803 Feb 08 17:30:45.350709 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 164/332] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:30:44 2022] POST /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/os-volume_attachments => generated 194 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:30:45.372466 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-9aed1a55-37cc-4c01-bad1-b09baaaa6613 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:45.375836 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-9aed1a55-37cc-4c01-bad1-b09baaaa6613 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:45.397121 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9aed1a55-37cc-4c01-bad1-b09baaaa6613 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:45.402439 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9aed1a55-37cc-4c01-bad1-b09baaaa6613 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:45.404419 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9aed1a55-37cc-4c01-bad1-b09baaaa6613 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:45.406481 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9aed1a55-37cc-4c01-bad1-b09baaaa6613 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:45.478058 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4e91a9df-21e1-4d6e-a721-041a7809d72c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:45.522125 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4e91a9df-21e1-4d6e-a721-041a7809d72c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1509 microversion: 2.1 time: 0.565608 Feb 08 17:30:45.525627 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 169/333] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:44 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1509 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:45.535725 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a0d15354-84d7-4d8d-93b2-bcdbbce358a2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:45.537054 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a0d15354-84d7-4d8d-93b2-bcdbbce358a2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:45.569515 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a0d15354-84d7-4d8d-93b2-bcdbbce358a2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:45.580319 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a0d15354-84d7-4d8d-93b2-bcdbbce358a2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:45.582552 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a0d15354-84d7-4d8d-93b2-bcdbbce358a2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:45.587919 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a0d15354-84d7-4d8d-93b2-bcdbbce358a2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:46.031960 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a0d15354-84d7-4d8d-93b2-bcdbbce358a2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:46.058867 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a0d15354-84d7-4d8d-93b2-bcdbbce358a2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1314 microversion: 2.1 time: 0.530791 Feb 08 17:30:46.059681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 170/334] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:45 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:46.082028 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7392f77a-bc6d-4933-903c-9c0d23976a7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:46.087050 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7392f77a-bc6d-4933-903c-9c0d23976a7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:46.113473 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7392f77a-bc6d-4933-903c-9c0d23976a7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:46.114660 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7392f77a-bc6d-4933-903c-9c0d23976a7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:46.116340 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7392f77a-bc6d-4933-903c-9c0d23976a7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:46.119261 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7392f77a-bc6d-4933-903c-9c0d23976a7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:46.217948 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-9aed1a55-37cc-4c01-bad1-b09baaaa6613 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:46.250329 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-9aed1a55-37cc-4c01-bad1-b09baaaa6613 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1468 microversion: 2.1 time: 0.884212 Feb 08 17:30:46.254996 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 165/335] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:45 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1468 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:46.580747 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4c4ffae6-b364-42ac-a854-fb3d5cbb5da1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:46.582133 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4c4ffae6-b364-42ac-a854-fb3d5cbb5da1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:46.594855 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4c4ffae6-b364-42ac-a854-fb3d5cbb5da1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:46.598745 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4c4ffae6-b364-42ac-a854-fb3d5cbb5da1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:46.599964 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4c4ffae6-b364-42ac-a854-fb3d5cbb5da1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:46.602281 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4c4ffae6-b364-42ac-a854-fb3d5cbb5da1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:46.663922 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7392f77a-bc6d-4933-903c-9c0d23976a7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:46.692780 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7392f77a-bc6d-4933-903c-9c0d23976a7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:46.696668 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7392f77a-bc6d-4933-903c-9c0d23976a7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:46.702540 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7392f77a-bc6d-4933-903c-9c0d23976a7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.641031 Feb 08 17:30:46.703561 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 171/336] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:46 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:46.942995 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4c4ffae6-b364-42ac-a854-fb3d5cbb5da1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:46.958507 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4c4ffae6-b364-42ac-a854-fb3d5cbb5da1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1509 microversion: 2.1 time: 0.383746 Feb 08 17:30:46.959723 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 166/337] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:46 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1509 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:47.095387 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d78f63ac-e458-4b34-91d6-d3aa2649d214 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:47.096090 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d78f63ac-e458-4b34-91d6-d3aa2649d214 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:47.118410 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d78f63ac-e458-4b34-91d6-d3aa2649d214 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:47.145536 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d78f63ac-e458-4b34-91d6-d3aa2649d214 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:47.150380 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d78f63ac-e458-4b34-91d6-d3aa2649d214 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:47.156395 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d78f63ac-e458-4b34-91d6-d3aa2649d214 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:47.287678 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-42eaa4cf-4baa-434d-997c-c77da9227956 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:47.290282 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-42eaa4cf-4baa-434d-997c-c77da9227956 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:47.307039 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42eaa4cf-4baa-434d-997c-c77da9227956 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:47.308957 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42eaa4cf-4baa-434d-997c-c77da9227956 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:47.310873 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42eaa4cf-4baa-434d-997c-c77da9227956 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:47.312183 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42eaa4cf-4baa-434d-997c-c77da9227956 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:47.762879 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d78f63ac-e458-4b34-91d6-d3aa2649d214 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:47.799476 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d78f63ac-e458-4b34-91d6-d3aa2649d214 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1498 microversion: 2.1 time: 0.712055 Feb 08 17:30:47.827900 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 172/338] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:47 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1498 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:47.846286 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-aa5867d3-515f-40bc-b2d1-0700f389983a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:47.855935 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-aa5867d3-515f-40bc-b2d1-0700f389983a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:47.885445 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa5867d3-515f-40bc-b2d1-0700f389983a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:47.888099 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa5867d3-515f-40bc-b2d1-0700f389983a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:47.889097 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa5867d3-515f-40bc-b2d1-0700f389983a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:47.895725 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aa5867d3-515f-40bc-b2d1-0700f389983a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:48.085252 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-42eaa4cf-4baa-434d-997c-c77da9227956 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:48.108997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-42eaa4cf-4baa-434d-997c-c77da9227956 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1468 microversion: 2.1 time: 0.829355 Feb 08 17:30:48.110096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 167/339] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:47 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1468 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:48.125785 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-05fb96c2-c526-49d4-843f-8c81fefafa8f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:48.130182 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-05fb96c2-c526-49d4-843f-8c81fefafa8f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:48.151483 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-05fb96c2-c526-49d4-843f-8c81fefafa8f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:48.152331 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-05fb96c2-c526-49d4-843f-8c81fefafa8f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:48.154354 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-05fb96c2-c526-49d4-843f-8c81fefafa8f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:48.155689 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-05fb96c2-c526-49d4-843f-8c81fefafa8f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:48.253591 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-aa5867d3-515f-40bc-b2d1-0700f389983a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:48.268798 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-aa5867d3-515f-40bc-b2d1-0700f389983a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:48.272568 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-aa5867d3-515f-40bc-b2d1-0700f389983a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:48.275089 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-aa5867d3-515f-40bc-b2d1-0700f389983a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.444830 Feb 08 17:30:48.276394 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 173/340] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:47 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:48.753787 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-05fb96c2-c526-49d4-843f-8c81fefafa8f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:48.765990 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-05fb96c2-c526-49d4-843f-8c81fefafa8f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1509 microversion: 2.1 time: 0.654125 Feb 08 17:30:48.767059 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 168/341] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:48 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1509 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:48.972723 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-86b51678-f552-4f59-865f-94ff2404fa4f req-e597db0f-c203-4988-9df8-23d3d64dc5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7282d48e-a1d2-4bb3-a4be-6692d6f27696", "name": "network-vif-deleted", "tag": "9e760b09-df83-444f-a5a7-0d8b668f4627"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:48.981609 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:30:48.981609 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:30:49.025613 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-86b51678-f552-4f59-865f-94ff2404fa4f req-e597db0f-c203-4988-9df8-23d3d64dc5b9 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.029092 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-86b51678-f552-4f59-865f-94ff2404fa4f req-e597db0f-c203-4988-9df8-23d3d64dc5b9 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:49.056713 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-86b51678-f552-4f59-865f-94ff2404fa4f req-e597db0f-c203-4988-9df8-23d3d64dc5b9 service nova] Creating event network-vif-deleted:9e760b09-df83-444f-a5a7-0d8b668f4627 for instance 7282d48e-a1d2-4bb3-a4be-6692d6f27696 on hv-cinder-82204 Feb 08 17:30:49.082022 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-86b51678-f552-4f59-865f-94ff2404fa4f req-e597db0f-c203-4988-9df8-23d3d64dc5b9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108912 Feb 08 17:30:49.083733 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 174/342] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:30:49.131158 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5214e04e-84c0-4527-898a-d8f9531482d2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:49.132898 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5214e04e-84c0-4527-898a-d8f9531482d2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:49.151029 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5214e04e-84c0-4527-898a-d8f9531482d2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.152210 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5214e04e-84c0-4527-898a-d8f9531482d2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:49.155069 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5214e04e-84c0-4527-898a-d8f9531482d2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.156268 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5214e04e-84c0-4527-898a-d8f9531482d2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:49.168896 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4e1aed44-ef01-4b99-ba27-1b519942b157 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:49.175703 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4e1aed44-ef01-4b99-ba27-1b519942b157 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:49.204461 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4e1aed44-ef01-4b99-ba27-1b519942b157 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.205699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4e1aed44-ef01-4b99-ba27-1b519942b157 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:49.210289 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4e1aed44-ef01-4b99-ba27-1b519942b157 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.212511 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5214e04e-84c0-4527-898a-d8f9531482d2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Going to try to terminate instance {{(pid=116479) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:30:49.213886 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4e1aed44-ef01-4b99-ba27-1b519942b157 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:49.291950 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4e1aed44-ef01-4b99-ba27-1b519942b157 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.293061 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4e1aed44-ef01-4b99-ba27-1b519942b157 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:49.294300 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-4e1aed44-ef01-4b99-ba27-1b519942b157 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lazy-loading 'fault' on Instance uuid 7282d48e-a1d2-4bb3-a4be-6692d6f27696 {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:30:49.451545 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4e1aed44-ef01-4b99-ba27-1b519942b157 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7746bed24ae89161e7337d297b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700878fc54924d3ba0fa14041a48d947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:49.454477 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5214e04e-84c0-4527-898a-d8f9531482d2 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 204 len: 0 microversion: 2.1 time: 0.328208 Feb 08 17:30:49.462204 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 169/343] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:30:49 2022] DELETE /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:30:49.470158 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4e1aed44-ef01-4b99-ba27-1b519942b157 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 200 len: 1303 microversion: 2.1 time: 0.334983 Feb 08 17:30:49.472588 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 175/344] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:49 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 1303 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:49.477212 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6bf05513-82f0-46b5-828a-daa65260871c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:49.478967 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6bf05513-82f0-46b5-828a-daa65260871c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:49.488051 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5e059537-efa7-4cf4-8b6f-ed34eb9b636a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:49.489703 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5e059537-efa7-4cf4-8b6f-ed34eb9b636a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:49.491331 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6bf05513-82f0-46b5-828a-daa65260871c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.492375 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6bf05513-82f0-46b5-828a-daa65260871c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:49.494983 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6bf05513-82f0-46b5-828a-daa65260871c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.495865 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6bf05513-82f0-46b5-828a-daa65260871c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:49.518512 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5e059537-efa7-4cf4-8b6f-ed34eb9b636a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.518512 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5e059537-efa7-4cf4-8b6f-ed34eb9b636a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:49.518953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5e059537-efa7-4cf4-8b6f-ed34eb9b636a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.520578 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5e059537-efa7-4cf4-8b6f-ed34eb9b636a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:49.887680 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6bf05513-82f0-46b5-828a-daa65260871c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:49.904030 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5e059537-efa7-4cf4-8b6f-ed34eb9b636a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:49.912709 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6bf05513-82f0-46b5-828a-daa65260871c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:49.915175 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5e059537-efa7-4cf4-8b6f-ed34eb9b636a tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1504 microversion: 2.1 time: 0.438062 Feb 08 17:30:49.916428 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 176/345] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:49 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:49.917526 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6bf05513-82f0-46b5-828a-daa65260871c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:49.919573 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6bf05513-82f0-46b5-828a-daa65260871c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.454548 Feb 08 17:30:49.920521 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 170/346] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:49 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:49.925069 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8155d938-4012-472d-a2a6-17ded16c0201 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:49.926536 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8155d938-4012-472d-a2a6-17ded16c0201 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:49.936990 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8155d938-4012-472d-a2a6-17ded16c0201 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.938047 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8155d938-4012-472d-a2a6-17ded16c0201 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:49.939404 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8155d938-4012-472d-a2a6-17ded16c0201 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:49.940141 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8155d938-4012-472d-a2a6-17ded16c0201 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:50.209233 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8155d938-4012-472d-a2a6-17ded16c0201 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:50.222242 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8155d938-4012-472d-a2a6-17ded16c0201 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1515 microversion: 2.1 time: 0.303387 Feb 08 17:30:50.223581 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 177/347] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:49 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:50.503348 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-88c0e7b8-b0ab-4414-b0ed-789c0c9adb63 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:50.505084 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-88c0e7b8-b0ab-4414-b0ed-789c0c9adb63 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] [instance: 7282d48e-a1d2-4bb3-a4be-6692d6f27696] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:50.514816 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-88c0e7b8-b0ab-4414-b0ed-789c0c9adb63 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:50.515258 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-88c0e7b8-b0ab-4414-b0ed-789c0c9adb63 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:50.516336 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-88c0e7b8-b0ab-4414-b0ed-789c0c9adb63 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:50.516753 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-88c0e7b8-b0ab-4414-b0ed-789c0c9adb63 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:50.534907 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-88c0e7b8-b0ab-4414-b0ed-789c0c9adb63 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] HTTP exception thrown: Instance 7282d48e-a1d2-4bb3-a4be-6692d6f27696 could not be found. Feb 08 17:30:50.535514 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-88c0e7b8-b0ab-4414-b0ed-789c0c9adb63 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] Returning 404 to user: Instance 7282d48e-a1d2-4bb3-a4be-6692d6f27696 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:30:50.536365 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-88c0e7b8-b0ab-4414-b0ed-789c0c9adb63 tempest-VolumesNegativeTest-1178590915 tempest-VolumesNegativeTest-1178590915-project] 10.222.0.69 "GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696" status: 404 len: 111 microversion: 2.1 time: 0.038677 Feb 08 17:30:50.537483 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 171/348] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:50 2022] GET /compute/v2.1/servers/7282d48e-a1d2-4bb3-a4be-6692d6f27696 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:30:50.949928 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f8defd22-bb52-4e50-a8d5-1b1d3a4fbeb5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:50.950148 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9cee8b27-5cc6-472e-9c19-a38fc2731daa tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:50.951306 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9cee8b27-5cc6-472e-9c19-a38fc2731daa tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:50.951503 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f8defd22-bb52-4e50-a8d5-1b1d3a4fbeb5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:50.961681 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f8defd22-bb52-4e50-a8d5-1b1d3a4fbeb5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:50.964547 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f8defd22-bb52-4e50-a8d5-1b1d3a4fbeb5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:50.965877 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f8defd22-bb52-4e50-a8d5-1b1d3a4fbeb5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:50.966304 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cee8b27-5cc6-472e-9c19-a38fc2731daa tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:50.966511 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f8defd22-bb52-4e50-a8d5-1b1d3a4fbeb5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:50.967119 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cee8b27-5cc6-472e-9c19-a38fc2731daa tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:50.968649 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cee8b27-5cc6-472e-9c19-a38fc2731daa tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:50.969608 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cee8b27-5cc6-472e-9c19-a38fc2731daa tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:51.312023 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9cee8b27-5cc6-472e-9c19-a38fc2731daa tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:51.323735 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9cee8b27-5cc6-472e-9c19-a38fc2731daa tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1504 microversion: 2.1 time: 0.385354 Feb 08 17:30:51.328187 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 178/349] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:50 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:51.339736 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f8defd22-bb52-4e50-a8d5-1b1d3a4fbeb5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:51.351397 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f8defd22-bb52-4e50-a8d5-1b1d3a4fbeb5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:51.356271 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f8defd22-bb52-4e50-a8d5-1b1d3a4fbeb5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:51.358943 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f8defd22-bb52-4e50-a8d5-1b1d3a4fbeb5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.415235 Feb 08 17:30:51.362756 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 172/350] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:50 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:52.351725 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-74215f5d-afcf-430c-87ff-230369e71c6e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:52.353877 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-74215f5d-afcf-430c-87ff-230369e71c6e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:52.361843 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-74215f5d-afcf-430c-87ff-230369e71c6e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:52.362805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-74215f5d-afcf-430c-87ff-230369e71c6e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:52.364020 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-74215f5d-afcf-430c-87ff-230369e71c6e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:52.364670 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-74215f5d-afcf-430c-87ff-230369e71c6e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:52.385931 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ac2e6180-5818-44bf-9cec-c695fd879b89 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:52.386713 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ac2e6180-5818-44bf-9cec-c695fd879b89 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:52.395115 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ac2e6180-5818-44bf-9cec-c695fd879b89 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:52.395575 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ac2e6180-5818-44bf-9cec-c695fd879b89 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:52.396394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ac2e6180-5818-44bf-9cec-c695fd879b89 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:52.396981 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ac2e6180-5818-44bf-9cec-c695fd879b89 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:52.635929 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-74215f5d-afcf-430c-87ff-230369e71c6e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:52.646755 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-74215f5d-afcf-430c-87ff-230369e71c6e tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1504 microversion: 2.1 time: 0.299715 Feb 08 17:30:52.647372 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 179/351] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:52 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:52.768404 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ac2e6180-5818-44bf-9cec-c695fd879b89 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:52.778660 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ac2e6180-5818-44bf-9cec-c695fd879b89 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:52.783123 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ac2e6180-5818-44bf-9cec-c695fd879b89 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:52.786049 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ac2e6180-5818-44bf-9cec-c695fd879b89 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.405030 Feb 08 17:30:52.801264 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 173/352] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:52 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:30:53.665722 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bfb9c202-59e4-4c3a-b4cc-d9897dbeb1b5 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:53.666341 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bfb9c202-59e4-4c3a-b4cc-d9897dbeb1b5 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:53.675329 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfb9c202-59e4-4c3a-b4cc-d9897dbeb1b5 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:53.676088 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfb9c202-59e4-4c3a-b4cc-d9897dbeb1b5 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:53.678449 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfb9c202-59e4-4c3a-b4cc-d9897dbeb1b5 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:53.679211 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfb9c202-59e4-4c3a-b4cc-d9897dbeb1b5 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:53.812032 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-78bcdd83-a7cc-49a4-8645-b3a6315f0c6d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:53.823272 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-78bcdd83-a7cc-49a4-8645-b3a6315f0c6d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:53.839866 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-78bcdd83-a7cc-49a4-8645-b3a6315f0c6d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:53.842215 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-78bcdd83-a7cc-49a4-8645-b3a6315f0c6d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:53.843695 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-78bcdd83-a7cc-49a4-8645-b3a6315f0c6d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:53.845005 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-78bcdd83-a7cc-49a4-8645-b3a6315f0c6d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:54.167016 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bfb9c202-59e4-4c3a-b4cc-d9897dbeb1b5 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:54.197272 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bfb9c202-59e4-4c3a-b4cc-d9897dbeb1b5 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1504 microversion: 2.1 time: 0.535836 Feb 08 17:30:54.209261 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 180/353] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:53 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:54.578297 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-78bcdd83-a7cc-49a4-8645-b3a6315f0c6d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:54.612641 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-78bcdd83-a7cc-49a4-8645-b3a6315f0c6d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:54.644841 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-78bcdd83-a7cc-49a4-8645-b3a6315f0c6d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:54.667637 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-78bcdd83-a7cc-49a4-8645-b3a6315f0c6d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.864667 Feb 08 17:30:54.685258 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 174/354] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:53 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:30:55.211844 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3b1b1346-841f-42cd-80c9-3cd3ec14602a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:55.212542 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3b1b1346-841f-42cd-80c9-3cd3ec14602a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:55.227640 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b1b1346-841f-42cd-80c9-3cd3ec14602a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:55.228225 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b1b1346-841f-42cd-80c9-3cd3ec14602a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:55.241859 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3776f086-7b55-4e6a-83f9-1494e2034667 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:55.244315 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3776f086-7b55-4e6a-83f9-1494e2034667 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:55.246043 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b1b1346-841f-42cd-80c9-3cd3ec14602a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:55.246714 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b1b1346-841f-42cd-80c9-3cd3ec14602a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:55.257665 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3776f086-7b55-4e6a-83f9-1494e2034667 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:55.259899 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3776f086-7b55-4e6a-83f9-1494e2034667 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:55.262243 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3776f086-7b55-4e6a-83f9-1494e2034667 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:55.263449 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3776f086-7b55-4e6a-83f9-1494e2034667 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:55.744157 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3776f086-7b55-4e6a-83f9-1494e2034667 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd9d3aa05e94f08a96a479e292141ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57af0d0aa794073a318653dc7c14c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:55.753592 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3776f086-7b55-4e6a-83f9-1494e2034667 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 200 len: 1504 microversion: 2.1 time: 0.517787 Feb 08 17:30:55.757326 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 175/355] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:55 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 1504 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:30:55.770302 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0c6be618-da54-4667-9b0b-27e61f8e27f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:55.772511 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0c6be618-da54-4667-9b0b-27e61f8e27f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:55.794401 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c6be618-da54-4667-9b0b-27e61f8e27f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:55.795346 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c6be618-da54-4667-9b0b-27e61f8e27f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:55.796387 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c6be618-da54-4667-9b0b-27e61f8e27f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:55.797713 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c6be618-da54-4667-9b0b-27e61f8e27f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:56.097520 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0c6be618-da54-4667-9b0b-27e61f8e27f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:56.112248 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0c6be618-da54-4667-9b0b-27e61f8e27f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:56.114356 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0c6be618-da54-4667-9b0b-27e61f8e27f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:56.116389 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0c6be618-da54-4667-9b0b-27e61f8e27f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.358011 Feb 08 17:30:56.117989 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 176/356] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:55 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:56.123898 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-4b8ff9a1-213c-408d-9e48-4a51c2e4b419 req-1d9012f5-a204-4495-9c28-8e67d9923ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2199cab3-4787-4cf5-aae1-ca10c35a9a4d", "name": "network-vif-deleted", "tag": "a16d3f1c-e76e-4cc4-b309-6b4ab737e4b3"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:56.125971 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:30:56.125971 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:30:56.127621 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3b1b1346-841f-42cd-80c9-3cd3ec14602a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:56.141470 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3b1b1346-841f-42cd-80c9-3cd3ec14602a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1515 microversion: 2.1 time: 0.930826 Feb 08 17:30:56.143774 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 181/357] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:55 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1515 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:56.157482 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-4b8ff9a1-213c-408d-9e48-4a51c2e4b419 req-1d9012f5-a204-4495-9c28-8e67d9923ccb service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:56.158323 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-4b8ff9a1-213c-408d-9e48-4a51c2e4b419 req-1d9012f5-a204-4495-9c28-8e67d9923ccb service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:56.170210 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e9ab5b8c-c18b-43f4-8ede-8bdbbe12ebd0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:56.187953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e9ab5b8c-c18b-43f4-8ede-8bdbbe12ebd0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:56.188294 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e9ab5b8c-c18b-43f4-8ede-8bdbbe12ebd0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:56.192617 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-4b8ff9a1-213c-408d-9e48-4a51c2e4b419 req-1d9012f5-a204-4495-9c28-8e67d9923ccb service nova] Creating event network-vif-deleted:a16d3f1c-e76e-4cc4-b309-6b4ab737e4b3 for instance 2199cab3-4787-4cf5-aae1-ca10c35a9a4d on hv-cinder-82204 Feb 08 17:30:56.223032 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-4b8ff9a1-213c-408d-9e48-4a51c2e4b419 req-1d9012f5-a204-4495-9c28-8e67d9923ccb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097338 Feb 08 17:30:56.224373 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 177/358] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:30:56.244367 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0c50b710-e68e-4b0f-b7b3-c863a7b31780 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19f436e0-f47b-4e02-b21f-ee3605a2bbf6"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:30:56.255884 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0c50b710-e68e-4b0f-b7b3-c863a7b31780 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:56.275228 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c50b710-e68e-4b0f-b7b3-c863a7b31780 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:56.282011 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c50b710-e68e-4b0f-b7b3-c863a7b31780 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:56.283001 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c50b710-e68e-4b0f-b7b3-c863a7b31780 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:56.283450 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c50b710-e68e-4b0f-b7b3-c863a7b31780 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:56.309681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e9ab5b8c-c18b-43f4-8ede-8bdbbe12ebd0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Going to try to stop instance {{(pid=116480) force_stop /opt/stack/nova/nova/compute/api.py:2655}} Feb 08 17:30:56.436391 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e9ab5b8c-c18b-43f4-8ede-8bdbbe12ebd0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "POST /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/action" status: 202 len: 0 microversion: 2.1 time: 0.291039 Feb 08 17:30:56.437129 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 182/359] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:30:56 2022] POST /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:30:56.451667 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-52e7f899-ab66-451c-9f52-6f6aa09cca99 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:56.452751 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-52e7f899-ab66-451c-9f52-6f6aa09cca99 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:56.468763 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-52e7f899-ab66-451c-9f52-6f6aa09cca99 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:56.469235 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-52e7f899-ab66-451c-9f52-6f6aa09cca99 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:56.470287 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-52e7f899-ab66-451c-9f52-6f6aa09cca99 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:56.470896 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-52e7f899-ab66-451c-9f52-6f6aa09cca99 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:56.921990 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0c50b710-e68e-4b0f-b7b3-c863a7b31780 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.692934 Feb 08 17:30:56.945933 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 178/360] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:30:56 2022] POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:30:56.961984 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b20cd26e-95f9-4193-b678-30900582a2b9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:56.962739 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b20cd26e-95f9-4193-b678-30900582a2b9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] [instance: 2199cab3-4787-4cf5-aae1-ca10c35a9a4d] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:56.963557 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-52e7f899-ab66-451c-9f52-6f6aa09cca99 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:56.981740 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b20cd26e-95f9-4193-b678-30900582a2b9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:56.983034 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b20cd26e-95f9-4193-b678-30900582a2b9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:56.987008 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-52e7f899-ab66-451c-9f52-6f6aa09cca99 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1722 microversion: 2.1 time: 0.543765 Feb 08 17:30:56.987904 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b20cd26e-95f9-4193-b678-30900582a2b9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:56.988464 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 183/361] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:56 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1722 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:56.999497 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b20cd26e-95f9-4193-b678-30900582a2b9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:57.031827 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-b20cd26e-95f9-4193-b678-30900582a2b9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] HTTP exception thrown: Instance 2199cab3-4787-4cf5-aae1-ca10c35a9a4d could not be found. Feb 08 17:30:57.033988 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b20cd26e-95f9-4193-b678-30900582a2b9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] Returning 404 to user: Instance 2199cab3-4787-4cf5-aae1-ca10c35a9a4d could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:30:57.035696 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b20cd26e-95f9-4193-b678-30900582a2b9 tempest-VolumesActionsTest-1650952993 tempest-VolumesActionsTest-1650952993-project] 10.222.0.69 "GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d" status: 404 len: 111 microversion: 2.1 time: 0.083250 Feb 08 17:30:57.040183 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 179/362] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:56 2022] GET /compute/v2.1/servers/2199cab3-4787-4cf5-aae1-ca10c35a9a4d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:30:57.154752 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e6ee22d1-9ce7-4dc0-9b5d-7070d035d896 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:57.162837 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e6ee22d1-9ce7-4dc0-9b5d-7070d035d896 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:57.203203 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e6ee22d1-9ce7-4dc0-9b5d-7070d035d896 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:57.212577 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e6ee22d1-9ce7-4dc0-9b5d-7070d035d896 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:57.214947 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e6ee22d1-9ce7-4dc0-9b5d-7070d035d896 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:57.220152 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e6ee22d1-9ce7-4dc0-9b5d-7070d035d896 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:57.707875 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e6ee22d1-9ce7-4dc0-9b5d-7070d035d896 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:57.749215 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e6ee22d1-9ce7-4dc0-9b5d-7070d035d896 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:57.759027 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e6ee22d1-9ce7-4dc0-9b5d-7070d035d896 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:57.764062 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e6ee22d1-9ce7-4dc0-9b5d-7070d035d896 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.618385 Feb 08 17:30:57.796339 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 184/363] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:57 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:58.012537 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7241627b-56ec-4d58-8fa6-4c56d7250bc1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:58.013726 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7241627b-56ec-4d58-8fa6-4c56d7250bc1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:58.067826 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7241627b-56ec-4d58-8fa6-4c56d7250bc1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:58.069373 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7241627b-56ec-4d58-8fa6-4c56d7250bc1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:58.073454 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7241627b-56ec-4d58-8fa6-4c56d7250bc1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:58.074610 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7241627b-56ec-4d58-8fa6-4c56d7250bc1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:58.663741 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-7241627b-56ec-4d58-8fa6-4c56d7250bc1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:58.707714 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7241627b-56ec-4d58-8fa6-4c56d7250bc1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1722 microversion: 2.1 time: 0.704312 Feb 08 17:30:58.745507 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 180/364] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:58 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1722 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:30:58.808820 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-36eddb4b-40ab-4000-a5ff-f4d46d390541 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:58.810527 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-36eddb4b-40ab-4000-a5ff-f4d46d390541 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:58.854270 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36eddb4b-40ab-4000-a5ff-f4d46d390541 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:58.855493 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36eddb4b-40ab-4000-a5ff-f4d46d390541 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:58.857900 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36eddb4b-40ab-4000-a5ff-f4d46d390541 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:58.859391 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36eddb4b-40ab-4000-a5ff-f4d46d390541 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:59.268276 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-36eddb4b-40ab-4000-a5ff-f4d46d390541 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:59.320570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-36eddb4b-40ab-4000-a5ff-f4d46d390541 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:59.325177 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-36eddb4b-40ab-4000-a5ff-f4d46d390541 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:30:59.334901 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-36eddb4b-40ab-4000-a5ff-f4d46d390541 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1746 microversion: 2.20 time: 0.539238 Feb 08 17:30:59.336613 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 185/365] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:30:58 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1746 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:30:59.750867 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-95b6e114-43e6-41da-b4cd-3b901aac1c3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:30:59.761779 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-95b6e114-43e6-41da-b4cd-3b901aac1c3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:30:59.781584 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-95b6e114-43e6-41da-b4cd-3b901aac1c3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:59.782458 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-95b6e114-43e6-41da-b4cd-3b901aac1c3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:30:59.783992 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-95b6e114-43e6-41da-b4cd-3b901aac1c3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:30:59.785359 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-95b6e114-43e6-41da-b4cd-3b901aac1c3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:00.379419 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ba5a66b6-45c7-4675-a686-fbfc543b0644 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:00.380895 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ba5a66b6-45c7-4675-a686-fbfc543b0644 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:00.394090 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ba5a66b6-45c7-4675-a686-fbfc543b0644 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:00.394375 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ba5a66b6-45c7-4675-a686-fbfc543b0644 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:00.397561 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-95b6e114-43e6-41da-b4cd-3b901aac1c3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:00.412095 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ba5a66b6-45c7-4675-a686-fbfc543b0644 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:00.412264 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-95b6e114-43e6-41da-b4cd-3b901aac1c3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1722 microversion: 2.1 time: 0.672976 Feb 08 17:31:00.412547 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ba5a66b6-45c7-4675-a686-fbfc543b0644 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:00.423907 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 181/366] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:30:59 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1722 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:00.674524 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ba5a66b6-45c7-4675-a686-fbfc543b0644 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:00.696209 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ba5a66b6-45c7-4675-a686-fbfc543b0644 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:00.700182 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ba5a66b6-45c7-4675-a686-fbfc543b0644 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:00.703071 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ba5a66b6-45c7-4675-a686-fbfc543b0644 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1746 microversion: 2.20 time: 0.335597 Feb 08 17:31:00.704856 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 186/367] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:00 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1746 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:01.438488 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-44c0e9e5-2129-4aef-9363-d11b3e9800c5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:01.439146 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-44c0e9e5-2129-4aef-9363-d11b3e9800c5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:01.452832 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-44c0e9e5-2129-4aef-9363-d11b3e9800c5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:01.453418 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-44c0e9e5-2129-4aef-9363-d11b3e9800c5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:01.454286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-44c0e9e5-2129-4aef-9363-d11b3e9800c5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:01.454882 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-44c0e9e5-2129-4aef-9363-d11b3e9800c5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:01.726369 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bd7b8ece-0a39-4de3-b855-3e109c61cccc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:01.728049 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bd7b8ece-0a39-4de3-b855-3e109c61cccc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:01.745075 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bd7b8ece-0a39-4de3-b855-3e109c61cccc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:01.745980 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bd7b8ece-0a39-4de3-b855-3e109c61cccc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:01.747115 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bd7b8ece-0a39-4de3-b855-3e109c61cccc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:01.748036 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bd7b8ece-0a39-4de3-b855-3e109c61cccc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:01.807183 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-44c0e9e5-2129-4aef-9363-d11b3e9800c5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:01.834127 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-44c0e9e5-2129-4aef-9363-d11b3e9800c5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1722 microversion: 2.1 time: 0.405586 Feb 08 17:31:01.845205 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 182/368] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:01 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:02.054103 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bd7b8ece-0a39-4de3-b855-3e109c61cccc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:02.073983 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bd7b8ece-0a39-4de3-b855-3e109c61cccc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:02.077584 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bd7b8ece-0a39-4de3-b855-3e109c61cccc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:02.080049 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bd7b8ece-0a39-4de3-b855-3e109c61cccc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1746 microversion: 2.20 time: 0.358183 Feb 08 17:31:02.093225 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 187/369] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:01 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1746 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:31:02.860096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5cdbcd67-722e-4194-a43b-6a738f4645b2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:02.860902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5cdbcd67-722e-4194-a43b-6a738f4645b2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:02.874025 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5cdbcd67-722e-4194-a43b-6a738f4645b2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:02.874960 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5cdbcd67-722e-4194-a43b-6a738f4645b2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:02.876656 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5cdbcd67-722e-4194-a43b-6a738f4645b2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:02.877240 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5cdbcd67-722e-4194-a43b-6a738f4645b2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:03.113570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2bdadac9-3b06-4417-839a-20c97a640c2a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:03.116026 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2bdadac9-3b06-4417-839a-20c97a640c2a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:03.146967 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5cdbcd67-722e-4194-a43b-6a738f4645b2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:03.155827 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2bdadac9-3b06-4417-839a-20c97a640c2a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:03.157993 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2bdadac9-3b06-4417-839a-20c97a640c2a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:03.159548 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2bdadac9-3b06-4417-839a-20c97a640c2a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:03.160269 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2bdadac9-3b06-4417-839a-20c97a640c2a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:03.161078 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5cdbcd67-722e-4194-a43b-6a738f4645b2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1722 microversion: 2.1 time: 0.306463 Feb 08 17:31:03.162131 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 183/370] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:02 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:03.561944 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2bdadac9-3b06-4417-839a-20c97a640c2a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:03.587861 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2bdadac9-3b06-4417-839a-20c97a640c2a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:03.597250 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2bdadac9-3b06-4417-839a-20c97a640c2a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:03.628564 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2bdadac9-3b06-4417-839a-20c97a640c2a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1746 microversion: 2.20 time: 0.493055 Feb 08 17:31:03.638871 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 188/371] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:03 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1746 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:31:04.199646 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bf01845c-d7e9-4123-862d-85224e238c01 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:04.202122 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-bf01845c-d7e9-4123-862d-85224e238c01 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:04.220677 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf01845c-d7e9-4123-862d-85224e238c01 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:04.222112 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf01845c-d7e9-4123-862d-85224e238c01 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:04.224014 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf01845c-d7e9-4123-862d-85224e238c01 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:04.226222 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf01845c-d7e9-4123-862d-85224e238c01 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:04.668694 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bfbdfded-e17e-41a0-aed7-1d77f059adeb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:04.672200 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bfbdfded-e17e-41a0-aed7-1d77f059adeb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:04.703566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfbdfded-e17e-41a0-aed7-1d77f059adeb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:04.704957 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfbdfded-e17e-41a0-aed7-1d77f059adeb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:04.708972 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfbdfded-e17e-41a0-aed7-1d77f059adeb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:04.714048 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfbdfded-e17e-41a0-aed7-1d77f059adeb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:05.091393 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bf01845c-d7e9-4123-862d-85224e238c01 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:05.159469 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bf01845c-d7e9-4123-862d-85224e238c01 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1722 microversion: 2.1 time: 0.973799 Feb 08 17:31:05.184843 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 184/372] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:04 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1722 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:05.270667 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-081221bb-dec0-4e9d-826f-038d4f3c7fb7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:31:05.272951 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-081221bb-dec0-4e9d-826f-038d4f3c7fb7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:05.290323 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bfbdfded-e17e-41a0-aed7-1d77f059adeb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:05.294432 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-081221bb-dec0-4e9d-826f-038d4f3c7fb7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:05.308994 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-081221bb-dec0-4e9d-826f-038d4f3c7fb7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:05.318166 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-081221bb-dec0-4e9d-826f-038d4f3c7fb7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:05.319484 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-081221bb-dec0-4e9d-826f-038d4f3c7fb7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:05.338287 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bfbdfded-e17e-41a0-aed7-1d77f059adeb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:05.357749 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bfbdfded-e17e-41a0-aed7-1d77f059adeb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:05.374396 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bfbdfded-e17e-41a0-aed7-1d77f059adeb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.715404 Feb 08 17:31:05.381891 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 189/373] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:04 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:05.390113 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-081221bb-dec0-4e9d-826f-038d4f3c7fb7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lazy-loading 'flavor' on Instance uuid 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:31:05.904671 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-081221bb-dec0-4e9d-826f-038d4f3c7fb7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/action" status: 200 len: 32 microversion: 2.1 time: 0.638560 Feb 08 17:31:05.906252 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 185/374] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:31:05 2022] POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/action => generated 32 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 08 17:31:05.920228 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0a589dee-381c-4780-9b03-b5a3d7a0ceff tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:05.924431 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0a589dee-381c-4780-9b03-b5a3d7a0ceff tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:05.963214 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a589dee-381c-4780-9b03-b5a3d7a0ceff tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:05.981834 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a589dee-381c-4780-9b03-b5a3d7a0ceff tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:05.988063 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a589dee-381c-4780-9b03-b5a3d7a0ceff tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:05.996599 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a589dee-381c-4780-9b03-b5a3d7a0ceff tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:06.215144 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8bd4fab6-42f8-4c8e-911a-74ded7b09d96 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:06.218147 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8bd4fab6-42f8-4c8e-911a-74ded7b09d96 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:06.241803 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8bd4fab6-42f8-4c8e-911a-74ded7b09d96 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:06.246132 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8bd4fab6-42f8-4c8e-911a-74ded7b09d96 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:06.250682 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8bd4fab6-42f8-4c8e-911a-74ded7b09d96 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:06.253577 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8bd4fab6-42f8-4c8e-911a-74ded7b09d96 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:06.569826 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0a589dee-381c-4780-9b03-b5a3d7a0ceff tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:06.592278 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0a589dee-381c-4780-9b03-b5a3d7a0ceff tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.677879 Feb 08 17:31:06.597241 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 190/375] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:05 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:06.602111 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c3fb0c74-9633-4fa4-aec4-44216e361227 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:06.603762 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c3fb0c74-9633-4fa4-aec4-44216e361227 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:06.615224 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c3fb0c74-9633-4fa4-aec4-44216e361227 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:06.616716 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c3fb0c74-9633-4fa4-aec4-44216e361227 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:06.618144 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c3fb0c74-9633-4fa4-aec4-44216e361227 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:06.619173 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c3fb0c74-9633-4fa4-aec4-44216e361227 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:07.369284 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c3fb0c74-9633-4fa4-aec4-44216e361227 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:07.397680 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c3fb0c74-9633-4fa4-aec4-44216e361227 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:07.399802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c3fb0c74-9633-4fa4-aec4-44216e361227 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:07.408073 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c3fb0c74-9633-4fa4-aec4-44216e361227 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.813184 Feb 08 17:31:07.425865 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 191/376] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:06 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:07.616633 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8cd665bc-172d-4e3e-bb6e-8b63f28f889e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:07.617585 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8cd665bc-172d-4e3e-bb6e-8b63f28f889e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:07.663754 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8cd665bc-172d-4e3e-bb6e-8b63f28f889e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:07.668908 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8cd665bc-172d-4e3e-bb6e-8b63f28f889e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:07.675552 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8cd665bc-172d-4e3e-bb6e-8b63f28f889e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:07.682369 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8cd665bc-172d-4e3e-bb6e-8b63f28f889e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:08.729546 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8cd665bc-172d-4e3e-bb6e-8b63f28f889e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:08.758566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8cd665bc-172d-4e3e-bb6e-8b63f28f889e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 1.146130 Feb 08 17:31:08.758566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 192/377] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:07 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:08.758566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-d68dba64-a1f2-42fc-9e0a-42a132aa8275 req-9956e385-f397-4976-b554-34d802497f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73f173b-bae7-44a2-b686-0179e64e9c30", "name": "network-vif-plugged", "status": "completed", "tag": "72759e6a-9d50-4192-90ea-3e1d17bb4b78"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:31:08.805106 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:31:08.805106 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:31:08.886134 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-d68dba64-a1f2-42fc-9e0a-42a132aa8275 req-9956e385-f397-4976-b554-34d802497f4e service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:08.886134 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-d68dba64-a1f2-42fc-9e0a-42a132aa8275 req-9956e385-f397-4976-b554-34d802497f4e service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:08.944589 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-d68dba64-a1f2-42fc-9e0a-42a132aa8275 req-9956e385-f397-4976-b554-34d802497f4e service nova] Creating event network-vif-plugged:72759e6a-9d50-4192-90ea-3e1d17bb4b78 for instance c73f173b-bae7-44a2-b686-0179e64e9c30 on hv-cinder-82204 Feb 08 17:31:08.953788 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-d68dba64-a1f2-42fc-9e0a-42a132aa8275 req-9956e385-f397-4976-b554-34d802497f4e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187228 Feb 08 17:31:08.954739 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 193/378] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:31:08.966379 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e68b6b27-8e6d-4c68-a596-2c86ae3516da tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:08.967592 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e68b6b27-8e6d-4c68-a596-2c86ae3516da tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:08.987570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e68b6b27-8e6d-4c68-a596-2c86ae3516da tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:08.988386 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e68b6b27-8e6d-4c68-a596-2c86ae3516da tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:08.989896 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e68b6b27-8e6d-4c68-a596-2c86ae3516da tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:08.990745 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e68b6b27-8e6d-4c68-a596-2c86ae3516da tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:09.532359 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8bd4fab6-42f8-4c8e-911a-74ded7b09d96 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:09.552409 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8bd4fab6-42f8-4c8e-911a-74ded7b09d96 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1722 microversion: 2.1 time: 3.341512 Feb 08 17:31:09.572604 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 186/379] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:06 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1722 bytes in 3362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:09.590724 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e68b6b27-8e6d-4c68-a596-2c86ae3516da tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:09.609869 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e68b6b27-8e6d-4c68-a596-2c86ae3516da tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:09.633126 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e68b6b27-8e6d-4c68-a596-2c86ae3516da tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:09.634946 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e68b6b27-8e6d-4c68-a596-2c86ae3516da tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.678704 Feb 08 17:31:09.646937 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 194/380] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:08 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:09.785675 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b3737e84-a8d2-4010-ace7-9c7a474e01e9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:09.786622 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b3737e84-a8d2-4010-ace7-9c7a474e01e9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:09.800499 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3737e84-a8d2-4010-ace7-9c7a474e01e9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:09.801914 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3737e84-a8d2-4010-ace7-9c7a474e01e9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:09.806503 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3737e84-a8d2-4010-ace7-9c7a474e01e9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:09.807502 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3737e84-a8d2-4010-ace7-9c7a474e01e9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:10.589492 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-086208bc-6409-4316-abd5-58049bf9dc89 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:10.590543 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-086208bc-6409-4316-abd5-58049bf9dc89 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:10.649902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-086208bc-6409-4316-abd5-58049bf9dc89 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:10.662611 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-086208bc-6409-4316-abd5-58049bf9dc89 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:10.663996 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-086208bc-6409-4316-abd5-58049bf9dc89 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:10.667614 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-086208bc-6409-4316-abd5-58049bf9dc89 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:11.404000 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-086208bc-6409-4316-abd5-58049bf9dc89 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:11.432144 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-086208bc-6409-4316-abd5-58049bf9dc89 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1722 microversion: 2.1 time: 0.847655 Feb 08 17:31:11.445633 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 195/381] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:10 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1722 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:11.460134 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c9e9cabb-aea3-4f7f-b37e-811f8fae177e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:11.465275 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c9e9cabb-aea3-4f7f-b37e-811f8fae177e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:11.474980 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c9e9cabb-aea3-4f7f-b37e-811f8fae177e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:11.475627 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c9e9cabb-aea3-4f7f-b37e-811f8fae177e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:11.477583 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c9e9cabb-aea3-4f7f-b37e-811f8fae177e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:11.479875 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c9e9cabb-aea3-4f7f-b37e-811f8fae177e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:11.989323 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c9e9cabb-aea3-4f7f-b37e-811f8fae177e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:12.026157 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b3737e84-a8d2-4010-ace7-9c7a474e01e9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:12.027963 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c9e9cabb-aea3-4f7f-b37e-811f8fae177e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:12.038609 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c9e9cabb-aea3-4f7f-b37e-811f8fae177e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:12.044983 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b3737e84-a8d2-4010-ace7-9c7a474e01e9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 2.265084 Feb 08 17:31:12.046154 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c9e9cabb-aea3-4f7f-b37e-811f8fae177e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.597427 Feb 08 17:31:12.049596 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 196/382] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:11 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:12.050706 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 187/383] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:09 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 2272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:12.453370 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0079b668-f0e6-4168-a009-e3fb3736a63d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:12.454592 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0079b668-f0e6-4168-a009-e3fb3736a63d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:12.496892 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0079b668-f0e6-4168-a009-e3fb3736a63d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:12.499147 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0079b668-f0e6-4168-a009-e3fb3736a63d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:12.501383 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0079b668-f0e6-4168-a009-e3fb3736a63d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:12.503313 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0079b668-f0e6-4168-a009-e3fb3736a63d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:13.076462 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0bc7a195-6cbd-4495-a395-3b486f841e43 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:13.077658 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0bc7a195-6cbd-4495-a395-3b486f841e43 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:13.130199 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0bc7a195-6cbd-4495-a395-3b486f841e43 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:13.130914 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0bc7a195-6cbd-4495-a395-3b486f841e43 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:13.139746 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0bc7a195-6cbd-4495-a395-3b486f841e43 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:13.154422 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0bc7a195-6cbd-4495-a395-3b486f841e43 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:13.291126 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0079b668-f0e6-4168-a009-e3fb3736a63d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:13.313451 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0079b668-f0e6-4168-a009-e3fb3736a63d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1722 microversion: 2.1 time: 0.862622 Feb 08 17:31:13.317422 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 197/384] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:12 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1722 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:13.358536 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bb4d8bb5-6635-4371-8717-d2dc06c97612 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:13.359950 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bb4d8bb5-6635-4371-8717-d2dc06c97612 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:13.396407 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bb4d8bb5-6635-4371-8717-d2dc06c97612 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:13.400865 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bb4d8bb5-6635-4371-8717-d2dc06c97612 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:13.437505 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bb4d8bb5-6635-4371-8717-d2dc06c97612 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:13.438831 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bb4d8bb5-6635-4371-8717-d2dc06c97612 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:13.863632 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0bc7a195-6cbd-4495-a395-3b486f841e43 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:13.873445 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0bc7a195-6cbd-4495-a395-3b486f841e43 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.804804 Feb 08 17:31:13.941260 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 188/385] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:13 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:14.049107 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bb4d8bb5-6635-4371-8717-d2dc06c97612 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:14.104708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bb4d8bb5-6635-4371-8717-d2dc06c97612 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:14.111021 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bb4d8bb5-6635-4371-8717-d2dc06c97612 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:14.112159 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bb4d8bb5-6635-4371-8717-d2dc06c97612 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.793065 Feb 08 17:31:14.126812 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 198/386] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:13 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:14.344316 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ce1f1aa4-e6aa-4ee4-bc10-4a5fa51f1efe tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:14.351288 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ce1f1aa4-e6aa-4ee4-bc10-4a5fa51f1efe tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:14.376007 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ce1f1aa4-e6aa-4ee4-bc10-4a5fa51f1efe tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:14.377294 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ce1f1aa4-e6aa-4ee4-bc10-4a5fa51f1efe tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:14.382008 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ce1f1aa4-e6aa-4ee4-bc10-4a5fa51f1efe tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:14.385143 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ce1f1aa4-e6aa-4ee4-bc10-4a5fa51f1efe tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:14.964920 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4a27bfd9-936f-4eed-860a-61077438cae1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:14.970335 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4a27bfd9-936f-4eed-860a-61077438cae1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:15.016093 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4a27bfd9-936f-4eed-860a-61077438cae1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:15.018222 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4a27bfd9-936f-4eed-860a-61077438cae1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:15.022390 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4a27bfd9-936f-4eed-860a-61077438cae1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:15.029013 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4a27bfd9-936f-4eed-860a-61077438cae1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:15.720062 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ce1f1aa4-e6aa-4ee4-bc10-4a5fa51f1efe tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:15.746211 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ce1f1aa4-e6aa-4ee4-bc10-4a5fa51f1efe tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1722 microversion: 2.1 time: 1.409585 Feb 08 17:31:15.763731 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4a27bfd9-936f-4eed-860a-61077438cae1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:15.765552 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 189/387] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:14 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1722 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:15.791235 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-275703d6-9f03-4a6d-83d1-8c3b2936b373 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:15.792555 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-275703d6-9f03-4a6d-83d1-8c3b2936b373 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:15.813000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-275703d6-9f03-4a6d-83d1-8c3b2936b373 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:15.813921 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-275703d6-9f03-4a6d-83d1-8c3b2936b373 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:15.816316 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-275703d6-9f03-4a6d-83d1-8c3b2936b373 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:15.817189 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-275703d6-9f03-4a6d-83d1-8c3b2936b373 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:15.833004 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4a27bfd9-936f-4eed-860a-61077438cae1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.880037 Feb 08 17:31:15.856817 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 199/388] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:14 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:16.771884 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-824339a7-8f73-4ce7-8d2d-b4ffc32bc0a7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:16.773186 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-824339a7-8f73-4ce7-8d2d-b4ffc32bc0a7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:16.792390 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-824339a7-8f73-4ce7-8d2d-b4ffc32bc0a7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:16.807387 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-824339a7-8f73-4ce7-8d2d-b4ffc32bc0a7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:16.809689 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-824339a7-8f73-4ce7-8d2d-b4ffc32bc0a7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:16.811017 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-824339a7-8f73-4ce7-8d2d-b4ffc32bc0a7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:17.480837 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-824339a7-8f73-4ce7-8d2d-b4ffc32bc0a7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:17.494625 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-824339a7-8f73-4ce7-8d2d-b4ffc32bc0a7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1722 microversion: 2.1 time: 0.727360 Feb 08 17:31:17.522697 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 200/389] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:16 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1722 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:17.567861 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-36dfd507-b3e9-47b9-be3a-5ea2715ff586 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:17.571458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-36dfd507-b3e9-47b9-be3a-5ea2715ff586 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:17.605058 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36dfd507-b3e9-47b9-be3a-5ea2715ff586 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:17.613607 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36dfd507-b3e9-47b9-be3a-5ea2715ff586 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:17.615692 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36dfd507-b3e9-47b9-be3a-5ea2715ff586 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:17.624767 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36dfd507-b3e9-47b9-be3a-5ea2715ff586 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:17.756020 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-275703d6-9f03-4a6d-83d1-8c3b2936b373 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:17.773827 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-275703d6-9f03-4a6d-83d1-8c3b2936b373 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:17.785973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-275703d6-9f03-4a6d-83d1-8c3b2936b373 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:17.790446 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-275703d6-9f03-4a6d-83d1-8c3b2936b373 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 2.022161 Feb 08 17:31:17.795449 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 190/390] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:15 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:18.101855 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-36dfd507-b3e9-47b9-be3a-5ea2715ff586 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:18.119992 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-36dfd507-b3e9-47b9-be3a-5ea2715ff586 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.588031 Feb 08 17:31:18.121094 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 201/391] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:17 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:18.523786 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2d73650a-86ad-48c5-a992-561c6d1bc9cd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:18.526777 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2d73650a-86ad-48c5-a992-561c6d1bc9cd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:18.550146 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2d73650a-86ad-48c5-a992-561c6d1bc9cd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:18.563110 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2d73650a-86ad-48c5-a992-561c6d1bc9cd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:18.565560 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2d73650a-86ad-48c5-a992-561c6d1bc9cd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:18.574090 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2d73650a-86ad-48c5-a992-561c6d1bc9cd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:18.824676 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5bcc0614-37f2-446f-a8e0-4184d622a45d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:18.832972 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5bcc0614-37f2-446f-a8e0-4184d622a45d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:18.858456 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5bcc0614-37f2-446f-a8e0-4184d622a45d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:18.860397 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5bcc0614-37f2-446f-a8e0-4184d622a45d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:18.862636 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5bcc0614-37f2-446f-a8e0-4184d622a45d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:18.866318 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5bcc0614-37f2-446f-a8e0-4184d622a45d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:19.411286 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5bcc0614-37f2-446f-a8e0-4184d622a45d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:19.435530 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5bcc0614-37f2-446f-a8e0-4184d622a45d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:19.449775 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5bcc0614-37f2-446f-a8e0-4184d622a45d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:19.454464 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5bcc0614-37f2-446f-a8e0-4184d622a45d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.636969 Feb 08 17:31:19.461351 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 202/392] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:18 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:19.471831 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-eb5b42c3-002e-4002-9697-3ac0ff2a8ad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:19.477539 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-eb5b42c3-002e-4002-9697-3ac0ff2a8ad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:19.498528 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eb5b42c3-002e-4002-9697-3ac0ff2a8ad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:19.499438 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eb5b42c3-002e-4002-9697-3ac0ff2a8ad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:19.508419 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eb5b42c3-002e-4002-9697-3ac0ff2a8ad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:19.510082 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eb5b42c3-002e-4002-9697-3ac0ff2a8ad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:20.091793 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2d73650a-86ad-48c5-a992-561c6d1bc9cd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:20.102546 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2d73650a-86ad-48c5-a992-561c6d1bc9cd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1699 microversion: 2.1 time: 1.589280 Feb 08 17:31:20.103469 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 191/393] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:18 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1699 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:20.124614 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-21bcf317-0732-4c13-a222-579613e6cb48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:31:20.151790 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-21bcf317-0732-4c13-a222-579613e6cb48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:20.152912 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-21bcf317-0732-4c13-a222-579613e6cb48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:20.288824 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-eb5b42c3-002e-4002-9697-3ac0ff2a8ad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:20.313436 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-eb5b42c3-002e-4002-9697-3ac0ff2a8ad2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.846404 Feb 08 17:31:20.314406 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 203/394] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:19 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:20.393576 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-21bcf317-0732-4c13-a222-579613e6cb48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Going to try to start instance {{(pid=116479) start /opt/stack/nova/nova/compute/api.py:2678}} Feb 08 17:31:20.496638 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0167cffd-f462-4a15-800b-eab80fdee9e9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:20.503817 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0167cffd-f462-4a15-800b-eab80fdee9e9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:20.518264 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-21bcf317-0732-4c13-a222-579613e6cb48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "POST /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/action" status: 202 len: 0 microversion: 2.1 time: 0.398210 Feb 08 17:31:20.520190 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 192/395] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:31:20 2022] POST /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:31:20.549245 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0167cffd-f462-4a15-800b-eab80fdee9e9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:20.557288 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-29692e5d-6f19-4ad9-8bbd-91436bea420a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:20.558582 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-29692e5d-6f19-4ad9-8bbd-91436bea420a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:20.559631 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0167cffd-f462-4a15-800b-eab80fdee9e9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:20.561391 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0167cffd-f462-4a15-800b-eab80fdee9e9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:20.574200 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0167cffd-f462-4a15-800b-eab80fdee9e9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:20.575395 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-29692e5d-6f19-4ad9-8bbd-91436bea420a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:20.576054 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-29692e5d-6f19-4ad9-8bbd-91436bea420a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:20.577031 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-29692e5d-6f19-4ad9-8bbd-91436bea420a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:20.577863 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-29692e5d-6f19-4ad9-8bbd-91436bea420a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:21.170874 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0167cffd-f462-4a15-800b-eab80fdee9e9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:21.198084 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0167cffd-f462-4a15-800b-eab80fdee9e9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:21.200469 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0167cffd-f462-4a15-800b-eab80fdee9e9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:21.202076 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0167cffd-f462-4a15-800b-eab80fdee9e9 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.714742 Feb 08 17:31:21.218924 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 204/396] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:20 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:21.334505 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fb6b4cf0-4e68-43a5-b00e-c815b18d33c0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:21.335798 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-fb6b4cf0-4e68-43a5-b00e-c815b18d33c0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:21.391397 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fb6b4cf0-4e68-43a5-b00e-c815b18d33c0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:21.392028 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fb6b4cf0-4e68-43a5-b00e-c815b18d33c0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:21.392954 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fb6b4cf0-4e68-43a5-b00e-c815b18d33c0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:21.397724 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fb6b4cf0-4e68-43a5-b00e-c815b18d33c0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:21.791517 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-29692e5d-6f19-4ad9-8bbd-91436bea420a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:21.819800 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-29692e5d-6f19-4ad9-8bbd-91436bea420a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1708 microversion: 2.1 time: 1.281146 Feb 08 17:31:21.837573 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 193/397] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:20 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1708 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:22.172318 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-fb6b4cf0-4e68-43a5-b00e-c815b18d33c0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:22.182925 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-fb6b4cf0-4e68-43a5-b00e-c815b18d33c0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.854972 Feb 08 17:31:22.184922 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 205/398] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:21 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:22.280117 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0a7e4e28-d341-4b50-82f9-e91c459b5463 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:22.280117 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0a7e4e28-d341-4b50-82f9-e91c459b5463 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:22.308350 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0a7e4e28-d341-4b50-82f9-e91c459b5463 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:22.314743 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0a7e4e28-d341-4b50-82f9-e91c459b5463 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:22.318529 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0a7e4e28-d341-4b50-82f9-e91c459b5463 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:22.319168 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0a7e4e28-d341-4b50-82f9-e91c459b5463 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:22.837916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bc79b57c-7e4a-4c3b-8a09-2eb3ed747ae5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:22.838948 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bc79b57c-7e4a-4c3b-8a09-2eb3ed747ae5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:22.858300 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bc79b57c-7e4a-4c3b-8a09-2eb3ed747ae5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:22.859702 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bc79b57c-7e4a-4c3b-8a09-2eb3ed747ae5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:22.862830 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bc79b57c-7e4a-4c3b-8a09-2eb3ed747ae5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:22.864291 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bc79b57c-7e4a-4c3b-8a09-2eb3ed747ae5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:23.215676 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bc79b57c-7e4a-4c3b-8a09-2eb3ed747ae5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:23.234866 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bc79b57c-7e4a-4c3b-8a09-2eb3ed747ae5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1708 microversion: 2.1 time: 0.400758 Feb 08 17:31:23.241870 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 206/399] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:22 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1708 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:23.256570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e5ad309b-50f8-4c07-b46b-9715efe3a93a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:23.257665 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e5ad309b-50f8-4c07-b46b-9715efe3a93a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:23.271678 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e5ad309b-50f8-4c07-b46b-9715efe3a93a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:23.272633 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e5ad309b-50f8-4c07-b46b-9715efe3a93a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:23.273880 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e5ad309b-50f8-4c07-b46b-9715efe3a93a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:23.274871 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e5ad309b-50f8-4c07-b46b-9715efe3a93a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:23.405692 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0a7e4e28-d341-4b50-82f9-e91c459b5463 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:23.481776 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0a7e4e28-d341-4b50-82f9-e91c459b5463 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:23.494003 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0a7e4e28-d341-4b50-82f9-e91c459b5463 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:23.500611 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0a7e4e28-d341-4b50-82f9-e91c459b5463 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 1.276661 Feb 08 17:31:23.509676 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 194/400] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:22 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:23.964123 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e5ad309b-50f8-4c07-b46b-9715efe3a93a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:23.986467 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e5ad309b-50f8-4c07-b46b-9715efe3a93a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.741157 Feb 08 17:31:23.997232 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 207/401] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:23 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:24.283294 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-dfa6944c-e309-4a40-a8a0-f906430110b3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:24.288286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-dfa6944c-e309-4a40-a8a0-f906430110b3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:24.320494 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dfa6944c-e309-4a40-a8a0-f906430110b3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:24.321012 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dfa6944c-e309-4a40-a8a0-f906430110b3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:24.322721 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dfa6944c-e309-4a40-a8a0-f906430110b3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:24.323374 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dfa6944c-e309-4a40-a8a0-f906430110b3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:24.531595 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-02c74ff8-1196-4cb2-b434-e5b36f771cd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:24.540359 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-02c74ff8-1196-4cb2-b434-e5b36f771cd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:24.579747 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-02c74ff8-1196-4cb2-b434-e5b36f771cd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:24.580631 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-02c74ff8-1196-4cb2-b434-e5b36f771cd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:24.582361 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-02c74ff8-1196-4cb2-b434-e5b36f771cd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:24.590365 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-02c74ff8-1196-4cb2-b434-e5b36f771cd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:24.936209 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-dfa6944c-e309-4a40-a8a0-f906430110b3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:24.957613 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-dfa6944c-e309-4a40-a8a0-f906430110b3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1708 microversion: 2.1 time: 0.701037 Feb 08 17:31:24.962179 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 195/402] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:24 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1708 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:25.013396 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-366357e4-771b-4323-9dd4-1fd38cf41ae3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:25.014469 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-366357e4-771b-4323-9dd4-1fd38cf41ae3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:25.035464 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-366357e4-771b-4323-9dd4-1fd38cf41ae3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:25.036279 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-366357e4-771b-4323-9dd4-1fd38cf41ae3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:25.037893 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-366357e4-771b-4323-9dd4-1fd38cf41ae3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:25.041301 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-366357e4-771b-4323-9dd4-1fd38cf41ae3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:25.220081 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-02c74ff8-1196-4cb2-b434-e5b36f771cd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:25.230300 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-02c74ff8-1196-4cb2-b434-e5b36f771cd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:25.238474 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-02c74ff8-1196-4cb2-b434-e5b36f771cd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:25.240727 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-02c74ff8-1196-4cb2-b434-e5b36f771cd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.716882 Feb 08 17:31:25.242250 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 208/403] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:24 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:31:25.488806 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-366357e4-771b-4323-9dd4-1fd38cf41ae3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:25.502224 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-366357e4-771b-4323-9dd4-1fd38cf41ae3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.495043 Feb 08 17:31:25.519194 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 196/404] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:25 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:25.992043 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-78e4d46a-cb59-461a-820b-aad64b66d678 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:25.993881 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-78e4d46a-cb59-461a-820b-aad64b66d678 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:26.037044 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-78e4d46a-cb59-461a-820b-aad64b66d678 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:26.041129 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-78e4d46a-cb59-461a-820b-aad64b66d678 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:26.042258 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-78e4d46a-cb59-461a-820b-aad64b66d678 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:26.042949 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-78e4d46a-cb59-461a-820b-aad64b66d678 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:26.269775 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-094da42f-397a-4ff8-b379-6d0cd5c57963 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:26.270391 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-094da42f-397a-4ff8-b379-6d0cd5c57963 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:26.294433 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-094da42f-397a-4ff8-b379-6d0cd5c57963 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:26.295311 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-094da42f-397a-4ff8-b379-6d0cd5c57963 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:26.298408 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-094da42f-397a-4ff8-b379-6d0cd5c57963 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:26.299362 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-094da42f-397a-4ff8-b379-6d0cd5c57963 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:26.535844 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-78e4d46a-cb59-461a-820b-aad64b66d678 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:26.563088 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-78e4d46a-cb59-461a-820b-aad64b66d678 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1712 microversion: 2.1 time: 0.582402 Feb 08 17:31:26.577255 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 209/405] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:25 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1712 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:26.582482 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-be1e4b99-0686-4255-8e72-16f9853674a3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:26.583871 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-be1e4b99-0686-4255-8e72-16f9853674a3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:26.613083 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be1e4b99-0686-4255-8e72-16f9853674a3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:26.615592 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be1e4b99-0686-4255-8e72-16f9853674a3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:26.617123 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be1e4b99-0686-4255-8e72-16f9853674a3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:26.618931 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be1e4b99-0686-4255-8e72-16f9853674a3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:26.735102 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-094da42f-397a-4ff8-b379-6d0cd5c57963 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:26.757735 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-094da42f-397a-4ff8-b379-6d0cd5c57963 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:26.766544 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-094da42f-397a-4ff8-b379-6d0cd5c57963 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:26.774635 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-094da42f-397a-4ff8-b379-6d0cd5c57963 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.509193 Feb 08 17:31:26.793588 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 197/406] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:26 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:27.036674 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-be1e4b99-0686-4255-8e72-16f9853674a3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:27.048416 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-be1e4b99-0686-4255-8e72-16f9853674a3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.469605 Feb 08 17:31:27.055382 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 210/407] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:26 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:27.805533 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ab3614be-c31d-44b0-acf0-801a1052bcb3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:27.807912 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ab3614be-c31d-44b0-acf0-801a1052bcb3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:27.856437 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ab3614be-c31d-44b0-acf0-801a1052bcb3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:27.867714 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ab3614be-c31d-44b0-acf0-801a1052bcb3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:27.878052 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ab3614be-c31d-44b0-acf0-801a1052bcb3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:27.879688 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ab3614be-c31d-44b0-acf0-801a1052bcb3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:28.072416 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-692a4537-c7ab-4737-bd61-e9f1a787e3c5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:28.075531 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-692a4537-c7ab-4737-bd61-e9f1a787e3c5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:28.091482 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-692a4537-c7ab-4737-bd61-e9f1a787e3c5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:28.091927 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-692a4537-c7ab-4737-bd61-e9f1a787e3c5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:28.114606 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-692a4537-c7ab-4737-bd61-e9f1a787e3c5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:28.119227 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-692a4537-c7ab-4737-bd61-e9f1a787e3c5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:28.520677 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ab3614be-c31d-44b0-acf0-801a1052bcb3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:28.536049 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ab3614be-c31d-44b0-acf0-801a1052bcb3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:28.546009 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ab3614be-c31d-44b0-acf0-801a1052bcb3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:28.548989 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ab3614be-c31d-44b0-acf0-801a1052bcb3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.751732 Feb 08 17:31:28.552694 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 198/408] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:27 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:31:28.646146 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-692a4537-c7ab-4737-bd61-e9f1a787e3c5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:28.668799 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-692a4537-c7ab-4737-bd61-e9f1a787e3c5 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.603098 Feb 08 17:31:28.669639 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 211/409] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:28 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:29.575587 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0bc0ed86-87c1-4e9a-b612-70fb85a05d39 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:29.577088 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0bc0ed86-87c1-4e9a-b612-70fb85a05d39 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:29.631654 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0bc0ed86-87c1-4e9a-b612-70fb85a05d39 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:29.634726 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0bc0ed86-87c1-4e9a-b612-70fb85a05d39 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:29.636414 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0bc0ed86-87c1-4e9a-b612-70fb85a05d39 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:29.640847 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0bc0ed86-87c1-4e9a-b612-70fb85a05d39 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:29.696377 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-dacc31d0-7f7d-43e4-b5c9-ceab65973c23 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:29.698411 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-dacc31d0-7f7d-43e4-b5c9-ceab65973c23 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:29.715732 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dacc31d0-7f7d-43e4-b5c9-ceab65973c23 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:29.720483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dacc31d0-7f7d-43e4-b5c9-ceab65973c23 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:29.729906 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dacc31d0-7f7d-43e4-b5c9-ceab65973c23 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:29.731083 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dacc31d0-7f7d-43e4-b5c9-ceab65973c23 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:30.125768 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-dacc31d0-7f7d-43e4-b5c9-ceab65973c23 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:30.136305 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0bc0ed86-87c1-4e9a-b612-70fb85a05d39 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:30.145975 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-dacc31d0-7f7d-43e4-b5c9-ceab65973c23 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.453312 Feb 08 17:31:30.153035 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 212/410] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:29 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:30.156554 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0bc0ed86-87c1-4e9a-b612-70fb85a05d39 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:30.159292 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0bc0ed86-87c1-4e9a-b612-70fb85a05d39 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:30.163346 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0bc0ed86-87c1-4e9a-b612-70fb85a05d39 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.592325 Feb 08 17:31:30.164270 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 199/411] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:29 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:31.182696 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-efbc7508-b8fe-4266-aa52-bf99f0d4c192 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:31.185064 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-efbc7508-b8fe-4266-aa52-bf99f0d4c192 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:31.199441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6ba2c89b-1cad-42ca-a1cd-9c017324e5a2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:31.200788 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6ba2c89b-1cad-42ca-a1cd-9c017324e5a2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:31.208348 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-efbc7508-b8fe-4266-aa52-bf99f0d4c192 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:31.213807 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-efbc7508-b8fe-4266-aa52-bf99f0d4c192 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:31.216241 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-efbc7508-b8fe-4266-aa52-bf99f0d4c192 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:31.218581 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6ba2c89b-1cad-42ca-a1cd-9c017324e5a2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:31.221002 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-efbc7508-b8fe-4266-aa52-bf99f0d4c192 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:31.228568 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6ba2c89b-1cad-42ca-a1cd-9c017324e5a2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:31.230375 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6ba2c89b-1cad-42ca-a1cd-9c017324e5a2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:31.231158 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6ba2c89b-1cad-42ca-a1cd-9c017324e5a2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:31.513901 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6ba2c89b-1cad-42ca-a1cd-9c017324e5a2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:31.539212 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-efbc7508-b8fe-4266-aa52-bf99f0d4c192 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:31.551637 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6ba2c89b-1cad-42ca-a1cd-9c017324e5a2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:31.555035 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-efbc7508-b8fe-4266-aa52-bf99f0d4c192 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.378911 Feb 08 17:31:31.557695 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 213/412] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:31 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:31.559056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6ba2c89b-1cad-42ca-a1cd-9c017324e5a2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:31.561403 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6ba2c89b-1cad-42ca-a1cd-9c017324e5a2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.368812 Feb 08 17:31:31.562377 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 200/413] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:31 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:31:32.576597 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9812762a-835c-45ca-8847-efb0090dae5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:32.577313 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9812762a-835c-45ca-8847-efb0090dae5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:32.593308 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a5bf7201-67ff-430a-956f-2983ec656e7d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:32.594980 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a5bf7201-67ff-430a-956f-2983ec656e7d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:32.609421 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9812762a-835c-45ca-8847-efb0090dae5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:32.610514 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9812762a-835c-45ca-8847-efb0090dae5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:32.611696 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9812762a-835c-45ca-8847-efb0090dae5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:32.613973 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9812762a-835c-45ca-8847-efb0090dae5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:32.616757 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a5bf7201-67ff-430a-956f-2983ec656e7d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:32.626150 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a5bf7201-67ff-430a-956f-2983ec656e7d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:32.629516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a5bf7201-67ff-430a-956f-2983ec656e7d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:32.630446 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a5bf7201-67ff-430a-956f-2983ec656e7d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:33.038539 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9812762a-835c-45ca-8847-efb0090dae5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:33.061704 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9812762a-835c-45ca-8847-efb0090dae5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.490633 Feb 08 17:31:33.078159 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a5bf7201-67ff-430a-956f-2983ec656e7d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:33.082464 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 214/414] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:32 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:33.092311 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a5bf7201-67ff-430a-956f-2983ec656e7d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:33.096503 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a5bf7201-67ff-430a-956f-2983ec656e7d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:33.099653 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a5bf7201-67ff-430a-956f-2983ec656e7d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.514245 Feb 08 17:31:33.101744 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 201/415] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:32 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:34.088746 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6999e3a0-6c0a-47c4-a1bb-6fd176ea4917 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:34.090415 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6999e3a0-6c0a-47c4-a1bb-6fd176ea4917 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:34.112761 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6999e3a0-6c0a-47c4-a1bb-6fd176ea4917 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:34.113696 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6999e3a0-6c0a-47c4-a1bb-6fd176ea4917 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:34.116685 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6999e3a0-6c0a-47c4-a1bb-6fd176ea4917 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:34.123596 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6999e3a0-6c0a-47c4-a1bb-6fd176ea4917 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:34.133076 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-75c1e3c0-90df-4c40-91e7-7144d20198fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:34.133874 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-75c1e3c0-90df-4c40-91e7-7144d20198fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:34.161197 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75c1e3c0-90df-4c40-91e7-7144d20198fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:34.161715 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75c1e3c0-90df-4c40-91e7-7144d20198fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:34.163219 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75c1e3c0-90df-4c40-91e7-7144d20198fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:34.181609 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75c1e3c0-90df-4c40-91e7-7144d20198fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:34.412061 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6999e3a0-6c0a-47c4-a1bb-6fd176ea4917 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:34.430190 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6999e3a0-6c0a-47c4-a1bb-6fd176ea4917 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.345088 Feb 08 17:31:34.432015 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 215/416] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:34 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:34.551633 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-75c1e3c0-90df-4c40-91e7-7144d20198fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:34.567255 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-75c1e3c0-90df-4c40-91e7-7144d20198fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:34.573230 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-75c1e3c0-90df-4c40-91e7-7144d20198fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:34.578526 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-75c1e3c0-90df-4c40-91e7-7144d20198fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.446876 Feb 08 17:31:34.581914 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 202/417] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:34 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:35.468440 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e5a8f584-e6c4-4df4-9e16-b03f31d600d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:35.469620 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e5a8f584-e6c4-4df4-9e16-b03f31d600d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:35.487970 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e5a8f584-e6c4-4df4-9e16-b03f31d600d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:35.488886 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e5a8f584-e6c4-4df4-9e16-b03f31d600d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:35.498894 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e5a8f584-e6c4-4df4-9e16-b03f31d600d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:35.500483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e5a8f584-e6c4-4df4-9e16-b03f31d600d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:35.610917 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1f4b008f-8471-4a91-8b7f-b1c4e3859f23 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:35.612536 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1f4b008f-8471-4a91-8b7f-b1c4e3859f23 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:35.662163 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1f4b008f-8471-4a91-8b7f-b1c4e3859f23 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:35.666526 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1f4b008f-8471-4a91-8b7f-b1c4e3859f23 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:35.672122 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1f4b008f-8471-4a91-8b7f-b1c4e3859f23 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:35.673861 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1f4b008f-8471-4a91-8b7f-b1c4e3859f23 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:35.794516 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e5a8f584-e6c4-4df4-9e16-b03f31d600d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:35.806849 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e5a8f584-e6c4-4df4-9e16-b03f31d600d1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.356939 Feb 08 17:31:35.820763 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 216/418] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:35 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:36.119482 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1f4b008f-8471-4a91-8b7f-b1c4e3859f23 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:36.149456 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1f4b008f-8471-4a91-8b7f-b1c4e3859f23 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:36.151183 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1f4b008f-8471-4a91-8b7f-b1c4e3859f23 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:36.152514 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1f4b008f-8471-4a91-8b7f-b1c4e3859f23 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.557925 Feb 08 17:31:36.153420 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 203/419] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:35 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:36.828608 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-24b29105-9991-482e-8fcc-337c222eee37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:36.830111 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-24b29105-9991-482e-8fcc-337c222eee37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:36.843129 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24b29105-9991-482e-8fcc-337c222eee37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:36.845841 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24b29105-9991-482e-8fcc-337c222eee37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:36.848518 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24b29105-9991-482e-8fcc-337c222eee37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:36.853956 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24b29105-9991-482e-8fcc-337c222eee37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:37.208550 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-80a00713-eb4c-4e2e-83da-af92a36715d2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:37.209894 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-80a00713-eb4c-4e2e-83da-af92a36715d2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:37.219913 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-80a00713-eb4c-4e2e-83da-af92a36715d2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:37.220657 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-80a00713-eb4c-4e2e-83da-af92a36715d2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:37.221670 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-80a00713-eb4c-4e2e-83da-af92a36715d2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:37.222257 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-80a00713-eb4c-4e2e-83da-af92a36715d2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:37.287670 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-24b29105-9991-482e-8fcc-337c222eee37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:37.329984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-24b29105-9991-482e-8fcc-337c222eee37 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.504893 Feb 08 17:31:37.342407 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 217/420] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:36 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:37.496043 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-80a00713-eb4c-4e2e-83da-af92a36715d2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:37.508163 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-80a00713-eb4c-4e2e-83da-af92a36715d2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:37.511549 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-80a00713-eb4c-4e2e-83da-af92a36715d2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:37.513340 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-80a00713-eb4c-4e2e-83da-af92a36715d2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.308693 Feb 08 17:31:37.514213 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 204/421] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:37 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:31:38.349614 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8fe236b8-37a1-496a-9e7e-357981583e5d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:38.351599 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8fe236b8-37a1-496a-9e7e-357981583e5d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:38.363498 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8fe236b8-37a1-496a-9e7e-357981583e5d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:38.364450 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8fe236b8-37a1-496a-9e7e-357981583e5d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:38.375256 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8fe236b8-37a1-496a-9e7e-357981583e5d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:38.375878 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8fe236b8-37a1-496a-9e7e-357981583e5d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:38.535149 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e06f61e7-58bf-43bf-a7cb-4c646ea0cbdb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:38.536818 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-e06f61e7-58bf-43bf-a7cb-4c646ea0cbdb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:38.544843 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e06f61e7-58bf-43bf-a7cb-4c646ea0cbdb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:38.545637 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e06f61e7-58bf-43bf-a7cb-4c646ea0cbdb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:38.547662 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e06f61e7-58bf-43bf-a7cb-4c646ea0cbdb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:38.553692 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e06f61e7-58bf-43bf-a7cb-4c646ea0cbdb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:38.625121 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8fe236b8-37a1-496a-9e7e-357981583e5d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:38.638400 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8fe236b8-37a1-496a-9e7e-357981583e5d tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.292326 Feb 08 17:31:38.639647 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 218/422] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:38 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:38.828162 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e06f61e7-58bf-43bf-a7cb-4c646ea0cbdb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:38.844727 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e06f61e7-58bf-43bf-a7cb-4c646ea0cbdb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:38.846359 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e06f61e7-58bf-43bf-a7cb-4c646ea0cbdb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:38.852633 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e06f61e7-58bf-43bf-a7cb-4c646ea0cbdb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.316187 Feb 08 17:31:38.852633 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 205/423] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:38 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:39.660323 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3cc61408-c877-4b88-80b1-008065519d18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:39.661743 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3cc61408-c877-4b88-80b1-008065519d18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:39.676872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3cc61408-c877-4b88-80b1-008065519d18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:39.678050 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3cc61408-c877-4b88-80b1-008065519d18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:39.679403 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3cc61408-c877-4b88-80b1-008065519d18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:39.680153 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3cc61408-c877-4b88-80b1-008065519d18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:39.919345 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bf3f0083-1dc2-42ef-a35e-9191796d2db2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:39.922046 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-bf3f0083-1dc2-42ef-a35e-9191796d2db2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:39.940993 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf3f0083-1dc2-42ef-a35e-9191796d2db2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:39.942232 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf3f0083-1dc2-42ef-a35e-9191796d2db2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:39.944436 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf3f0083-1dc2-42ef-a35e-9191796d2db2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:39.945606 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf3f0083-1dc2-42ef-a35e-9191796d2db2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:39.974191 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3cc61408-c877-4b88-80b1-008065519d18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:39.992547 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3cc61408-c877-4b88-80b1-008065519d18 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.336003 Feb 08 17:31:39.994235 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 219/424] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:39 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:40.276879 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bf3f0083-1dc2-42ef-a35e-9191796d2db2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:40.297927 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bf3f0083-1dc2-42ef-a35e-9191796d2db2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:40.300722 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bf3f0083-1dc2-42ef-a35e-9191796d2db2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:40.302007 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bf3f0083-1dc2-42ef-a35e-9191796d2db2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1741 microversion: 2.20 time: 0.431257 Feb 08 17:31:40.313623 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 206/425] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:39 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1741 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:41.014721 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a6e31291-6a5f-44c0-9097-2d5b6135ab26 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:41.015649 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a6e31291-6a5f-44c0-9097-2d5b6135ab26 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:41.021458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a6e31291-6a5f-44c0-9097-2d5b6135ab26 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:41.022155 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a6e31291-6a5f-44c0-9097-2d5b6135ab26 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:41.023130 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a6e31291-6a5f-44c0-9097-2d5b6135ab26 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:41.023751 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a6e31291-6a5f-44c0-9097-2d5b6135ab26 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:41.307738 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a6e31291-6a5f-44c0-9097-2d5b6135ab26 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:41.321897 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a6e31291-6a5f-44c0-9097-2d5b6135ab26 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.310133 Feb 08 17:31:41.332090 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 220/426] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:41 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:41.338058 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-fe989f17-dad4-42f9-bff9-a66e20de039c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:41.338708 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-fe989f17-dad4-42f9-bff9-a66e20de039c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:41.345629 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe989f17-dad4-42f9-bff9-a66e20de039c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:41.346376 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe989f17-dad4-42f9-bff9-a66e20de039c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:41.347188 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe989f17-dad4-42f9-bff9-a66e20de039c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:41.347774 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe989f17-dad4-42f9-bff9-a66e20de039c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:41.636087 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-fe989f17-dad4-42f9-bff9-a66e20de039c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:41.649951 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-fe989f17-dad4-42f9-bff9-a66e20de039c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:41.652110 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-fe989f17-dad4-42f9-bff9-a66e20de039c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:41.653786 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-fe989f17-dad4-42f9-bff9-a66e20de039c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1723 microversion: 2.20 time: 0.320287 Feb 08 17:31:41.662549 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 207/427] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:41 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:42.340594 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-dd14cc16-4197-4065-844a-13f69ca9cff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:42.346039 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-dd14cc16-4197-4065-844a-13f69ca9cff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:42.356318 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dd14cc16-4197-4065-844a-13f69ca9cff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:42.357381 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dd14cc16-4197-4065-844a-13f69ca9cff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:42.358993 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dd14cc16-4197-4065-844a-13f69ca9cff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:42.359893 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dd14cc16-4197-4065-844a-13f69ca9cff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:42.567921 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-dd14cc16-4197-4065-844a-13f69ca9cff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:42.586360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-dd14cc16-4197-4065-844a-13f69ca9cff0 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.249927 Feb 08 17:31:42.603460 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 221/428] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:42 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:42.680932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-83420bdf-9bf5-4c09-87a4-d096bfe1c4f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:42.681772 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-83420bdf-9bf5-4c09-87a4-d096bfe1c4f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:42.691310 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-83420bdf-9bf5-4c09-87a4-d096bfe1c4f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:42.693905 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-83420bdf-9bf5-4c09-87a4-d096bfe1c4f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:42.694922 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-83420bdf-9bf5-4c09-87a4-d096bfe1c4f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:42.695530 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-83420bdf-9bf5-4c09-87a4-d096bfe1c4f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:42.870063 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-83420bdf-9bf5-4c09-87a4-d096bfe1c4f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:42.880186 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-83420bdf-9bf5-4c09-87a4-d096bfe1c4f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:42.881135 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-83420bdf-9bf5-4c09-87a4-d096bfe1c4f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:42.882352 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-83420bdf-9bf5-4c09-87a4-d096bfe1c4f8 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1723 microversion: 2.20 time: 0.205276 Feb 08 17:31:42.883293 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 208/429] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:42 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:43.615716 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-85243803-5f3e-45c4-a9ae-a5d306832f4b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:43.616731 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-85243803-5f3e-45c4-a9ae-a5d306832f4b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:43.628469 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-85243803-5f3e-45c4-a9ae-a5d306832f4b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:43.629674 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-85243803-5f3e-45c4-a9ae-a5d306832f4b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:43.631054 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-85243803-5f3e-45c4-a9ae-a5d306832f4b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:43.631669 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-85243803-5f3e-45c4-a9ae-a5d306832f4b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:43.851300 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-85243803-5f3e-45c4-a9ae-a5d306832f4b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:43.871051 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-85243803-5f3e-45c4-a9ae-a5d306832f4b tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.261240 Feb 08 17:31:43.872534 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 222/430] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:43 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:43.909961 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bf03f9bd-1752-42e0-b220-4f52aa83aae4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:43.915989 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-bf03f9bd-1752-42e0-b220-4f52aa83aae4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:43.927746 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf03f9bd-1752-42e0-b220-4f52aa83aae4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:43.929315 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf03f9bd-1752-42e0-b220-4f52aa83aae4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:43.931470 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf03f9bd-1752-42e0-b220-4f52aa83aae4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:43.932507 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf03f9bd-1752-42e0-b220-4f52aa83aae4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:44.193278 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-6c263a08-94e1-48e3-929c-3e06eac6ba0e req-1688d72a-cd64-4a4d-a1f2-23ab68f3879f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73f173b-bae7-44a2-b686-0179e64e9c30", "name": "network-vif-unplugged", "status": "completed", "tag": "72759e6a-9d50-4192-90ea-3e1d17bb4b78"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:31:44.195566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:31:44.195566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:31:44.203909 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-6c263a08-94e1-48e3-929c-3e06eac6ba0e req-1688d72a-cd64-4a4d-a1f2-23ab68f3879f service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:44.204689 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-6c263a08-94e1-48e3-929c-3e06eac6ba0e req-1688d72a-cd64-4a4d-a1f2-23ab68f3879f service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:44.217933 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-6c263a08-94e1-48e3-929c-3e06eac6ba0e req-1688d72a-cd64-4a4d-a1f2-23ab68f3879f service nova] Creating event network-vif-unplugged:72759e6a-9d50-4192-90ea-3e1d17bb4b78 for instance c73f173b-bae7-44a2-b686-0179e64e9c30 on hv-cinder-82204 Feb 08 17:31:44.224099 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-6c263a08-94e1-48e3-929c-3e06eac6ba0e req-1688d72a-cd64-4a4d-a1f2-23ab68f3879f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034731 Feb 08 17:31:44.230705 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 223/431] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:31:44.298755 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bf03f9bd-1752-42e0-b220-4f52aa83aae4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:44.335400 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bf03f9bd-1752-42e0-b220-4f52aa83aae4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:44.338754 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bf03f9bd-1752-42e0-b220-4f52aa83aae4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:44.341276 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bf03f9bd-1752-42e0-b220-4f52aa83aae4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1723 microversion: 2.20 time: 0.438399 Feb 08 17:31:44.342366 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 209/432] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:43 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:44.902520 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bfbf22dc-035e-48d2-ae72-af93c01d2abd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:44.903846 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bfbf22dc-035e-48d2-ae72-af93c01d2abd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:44.911054 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfbf22dc-035e-48d2-ae72-af93c01d2abd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:44.911943 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfbf22dc-035e-48d2-ae72-af93c01d2abd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:44.912987 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfbf22dc-035e-48d2-ae72-af93c01d2abd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:44.913966 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfbf22dc-035e-48d2-ae72-af93c01d2abd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:45.094351 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bfbf22dc-035e-48d2-ae72-af93c01d2abd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:45.104783 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bfbf22dc-035e-48d2-ae72-af93c01d2abd tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.207781 Feb 08 17:31:45.105520 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 224/433] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:44 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:45.291174 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b8b76544-6e07-4745-ab24-2ac56476ba38 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Action: 'create', calling method: .version_select at 0x7fd9f9a82160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-586901702"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:31:45.320581 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-b8b76544-6e07-4745-ab24-2ac56476ba38 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Getting quotas for project b73d5104d66948b984ce1c84170053b3. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:31:45.332946 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-b8b76544-6e07-4745-ab24-2ac56476ba38 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Getting quotas for user 621091c3c9fa42c7b98ec2d2b49d2c83 and project b73d5104d66948b984ce1c84170053b3. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:31:45.346083 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b8b76544-6e07-4745-ab24-2ac56476ba38 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [c046678a-8647-44f2-8bab-b4d00dcd74e6] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 08 17:31:45.371046 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-71339cfb-7604-4bef-aee2-c8ae2ba2ba10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:45.371992 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-71339cfb-7604-4bef-aee2-c8ae2ba2ba10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:45.378510 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71339cfb-7604-4bef-aee2-c8ae2ba2ba10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:45.378510 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71339cfb-7604-4bef-aee2-c8ae2ba2ba10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:45.383256 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71339cfb-7604-4bef-aee2-c8ae2ba2ba10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:45.383256 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71339cfb-7604-4bef-aee2-c8ae2ba2ba10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:45.585528 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-71339cfb-7604-4bef-aee2-c8ae2ba2ba10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:45.600030 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-71339cfb-7604-4bef-aee2-c8ae2ba2ba10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:45.603809 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-71339cfb-7604-4bef-aee2-c8ae2ba2ba10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:45.605977 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-71339cfb-7604-4bef-aee2-c8ae2ba2ba10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1723 microversion: 2.20 time: 0.239843 Feb 08 17:31:45.607076 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 225/434] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:45 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:46.128239 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f16f19d9-efee-428f-a449-68a988401572 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:46.129316 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f16f19d9-efee-428f-a449-68a988401572 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:46.142850 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f16f19d9-efee-428f-a449-68a988401572 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:46.142850 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f16f19d9-efee-428f-a449-68a988401572 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:46.142850 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f16f19d9-efee-428f-a449-68a988401572 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:46.142850 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f16f19d9-efee-428f-a449-68a988401572 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:46.365921 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO oslo.messaging._drivers.impl_rabbit [None req-b8b76544-6e07-4745-ab24-2ac56476ba38 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [c046678a-8647-44f2-8bab-b4d00dcd74e6] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 39012. Feb 08 17:31:46.403834 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f16f19d9-efee-428f-a449-68a988401572 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:46.417789 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f16f19d9-efee-428f-a449-68a988401572 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.293636 Feb 08 17:31:46.419957 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 226/435] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:46 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:46.493785 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-b8b76544-6e07-4745-ab24-2ac56476ba38 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Getting quotas for project b73d5104d66948b984ce1c84170053b3. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:31:46.499290 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-b8b76544-6e07-4745-ab24-2ac56476ba38 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Getting quotas for user 621091c3c9fa42c7b98ec2d2b49d2c83 and project b73d5104d66948b984ce1c84170053b3. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:31:46.513768 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b8b76544-6e07-4745-ab24-2ac56476ba38 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 1.226530 Feb 08 17:31:46.514375 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 210/436] 10.222.0.69 () {60 vars in 1157 bytes} [Tue Feb 8 17:31:45 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:46.630244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5dc3dec4-bc36-4c83-a325-434d403fe7d1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:46.630854 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5dc3dec4-bc36-4c83-a325-434d403fe7d1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:46.637922 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5dc3dec4-bc36-4c83-a325-434d403fe7d1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:46.638120 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1923081376", "imageRef": "3e4a1c98-6cc8-48f9-8aa6-ba52ff964340", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-586901702", "networks": [{"uuid": "7f60fd81-e59c-4078-b469-d943d1c2c31b"}]}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:31:46.638770 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5dc3dec4-bc36-4c83-a325-434d403fe7d1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:46.639760 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5dc3dec4-bc36-4c83-a325-434d403fe7d1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:46.640360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5dc3dec4-bc36-4c83-a325-434d403fe7d1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:46.704341 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.network.neutron [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] validate_networks() for [('7f60fd81-e59c-4078-b469-d943d1c2c31b', None, None, None, None, None)] {{(pid=116479) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:31:46.837754 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5dc3dec4-bc36-4c83-a325-434d403fe7d1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:46.855773 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5dc3dec4-bc36-4c83-a325-434d403fe7d1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:46.858383 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5dc3dec4-bc36-4c83-a325-434d403fe7d1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:46.860241 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5dc3dec4-bc36-4c83-a325-434d403fe7d1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1723 microversion: 2.20 time: 0.234147 Feb 08 17:31:46.880924 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 227/437] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:46 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:31:47.438508 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8510d366-e4c7-4e0a-b9ed-566e1bf3b288 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:47.439319 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8510d366-e4c7-4e0a-b9ed-566e1bf3b288 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:47.452970 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8510d366-e4c7-4e0a-b9ed-566e1bf3b288 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:47.453368 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8510d366-e4c7-4e0a-b9ed-566e1bf3b288 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:47.454534 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8510d366-e4c7-4e0a-b9ed-566e1bf3b288 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:47.455196 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8510d366-e4c7-4e0a-b9ed-566e1bf3b288 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:47.544585 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Flavor limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:31:47.544585 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Image limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:31:47.546036 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Flavor pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:31:47.547396 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Image pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:31:47.548027 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:31:47.566665 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:47.567212 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:47.568154 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:47.568907 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:47.597970 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Getting quotas for project b73d5104d66948b984ce1c84170053b3. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:31:47.604347 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Getting quotas for user 621091c3c9fa42c7b98ec2d2b49d2c83 and project b73d5104d66948b984ce1c84170053b3. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:31:47.618662 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Going to run 1 instances... {{(pid=116479) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:31:47.621235 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3e4a1c98-6cc8-48f9-8aa6-ba52ff964340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:31:47.627656 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8510d366-e4c7-4e0a-b9ed-566e1bf3b288 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:47.635790 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8510d366-e4c7-4e0a-b9ed-566e1bf3b288 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.200963 Feb 08 17:31:47.636701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 228/438] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:47 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:47.681228 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3d945e8e-f367-45f2-b7ae-5733e21eeb96 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048876 Feb 08 17:31:47.682197 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 211/439] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:31:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:31:47.695653 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9a7d6ffa-266d-4a70-a47b-506d01f2dec8 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:47.696774 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9a7d6ffa-266d-4a70-a47b-506d01f2dec8 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:47.774123 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9a7d6ffa-266d-4a70-a47b-506d01f2dec8 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:47.782838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9a7d6ffa-266d-4a70-a47b-506d01f2dec8 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1258 microversion: 2.1 time: 0.093251 Feb 08 17:31:47.783534 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 229/440] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:47 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:47.890313 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-627f8c0f-73ab-451f-9fc5-f7a7cc304e5b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:47.891044 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-627f8c0f-73ab-451f-9fc5-f7a7cc304e5b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:47.902387 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-627f8c0f-73ab-451f-9fc5-f7a7cc304e5b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:47.903091 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-627f8c0f-73ab-451f-9fc5-f7a7cc304e5b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:47.904788 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-627f8c0f-73ab-451f-9fc5-f7a7cc304e5b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:47.906393 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-627f8c0f-73ab-451f-9fc5-f7a7cc304e5b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:48.111215 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-627f8c0f-73ab-451f-9fc5-f7a7cc304e5b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:48.121711 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-627f8c0f-73ab-451f-9fc5-f7a7cc304e5b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:48.125007 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-627f8c0f-73ab-451f-9fc5-f7a7cc304e5b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:48.127376 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-627f8c0f-73ab-451f-9fc5-f7a7cc304e5b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1666 microversion: 2.20 time: 0.242644 Feb 08 17:31:48.141723 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 212/441] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:47 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1666 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:48.152266 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d03abf80-212d-4e56-85dd-9d66924fde9f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f81e6ac8-b541-49e2-af34-6d7ac8651479"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:31:48.153796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d03abf80-212d-4e56-85dd-9d66924fde9f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:48.161708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d03abf80-212d-4e56-85dd-9d66924fde9f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:48.162802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d03abf80-212d-4e56-85dd-9d66924fde9f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:48.164222 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d03abf80-212d-4e56-85dd-9d66924fde9f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:48.164958 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d03abf80-212d-4e56-85dd-9d66924fde9f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:48.595252 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d03abf80-212d-4e56-85dd-9d66924fde9f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "POST /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.448084 Feb 08 17:31:48.598677 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 230/442] 10.222.0.69 () {62 vars in 1363 bytes} [Tue Feb 8 17:31:48 2022] POST /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments => generated 188 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:31:48.658137 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3c92638e-66d3-4943-964f-a22ce5243e60 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:48.659082 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3c92638e-66d3-4943-964f-a22ce5243e60 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:48.679307 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3c92638e-66d3-4943-964f-a22ce5243e60 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:48.680549 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3c92638e-66d3-4943-964f-a22ce5243e60 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:48.681484 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3c92638e-66d3-4943-964f-a22ce5243e60 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:48.681953 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3c92638e-66d3-4943-964f-a22ce5243e60 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:48.809327 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7436b722-265b-485f-abe9-cc94c64a81e1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:31:48.809920 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7436b722-265b-485f-abe9-cc94c64a81e1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:48.819696 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7436b722-265b-485f-abe9-cc94c64a81e1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:48.820762 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7436b722-265b-485f-abe9-cc94c64a81e1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:48.821955 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7436b722-265b-485f-abe9-cc94c64a81e1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:48.822987 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7436b722-265b-485f-abe9-cc94c64a81e1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:48.904772 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3c92638e-66d3-4943-964f-a22ce5243e60 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:48.916559 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3c92638e-66d3-4943-964f-a22ce5243e60 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.266037 Feb 08 17:31:48.930624 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 213/443] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:48 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:48.938923 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-32526bc7-71bf-4069-a805-961d2a9c619a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:48.939708 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-32526bc7-71bf-4069-a805-961d2a9c619a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:48.947704 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-32526bc7-71bf-4069-a805-961d2a9c619a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:48.948435 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-32526bc7-71bf-4069-a805-961d2a9c619a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:48.949269 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-32526bc7-71bf-4069-a805-961d2a9c619a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:48.949703 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-32526bc7-71bf-4069-a805-961d2a9c619a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:48.962764 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7436b722-265b-485f-abe9-cc94c64a81e1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "POST /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/action" status: 202 len: 0 microversion: 2.20 time: 0.158490 Feb 08 17:31:48.964052 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 231/444] 10.222.0.69 () {62 vars in 1318 bytes} [Tue Feb 8 17:31:48 2022] POST /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 08 17:31:48.979688 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a5c8d3b8-9373-4e16-81a3-72f0b6091baf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:48.981122 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a5c8d3b8-9373-4e16-81a3-72f0b6091baf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:48.987861 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a5c8d3b8-9373-4e16-81a3-72f0b6091baf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:48.988559 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a5c8d3b8-9373-4e16-81a3-72f0b6091baf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:48.989568 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a5c8d3b8-9373-4e16-81a3-72f0b6091baf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:48.990275 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a5c8d3b8-9373-4e16-81a3-72f0b6091baf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:49.056068 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-32526bc7-71bf-4069-a805-961d2a9c619a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:49.074738 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-32526bc7-71bf-4069-a805-961d2a9c619a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1310 microversion: 2.1 time: 0.142822 Feb 08 17:31:49.075799 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 214/445] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:48 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1310 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:49.201818 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a5c8d3b8-9373-4e16-81a3-72f0b6091baf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:49.214157 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a5c8d3b8-9373-4e16-81a3-72f0b6091baf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:49.215968 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a5c8d3b8-9373-4e16-81a3-72f0b6091baf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:49.217411 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a5c8d3b8-9373-4e16-81a3-72f0b6091baf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1752 microversion: 2.20 time: 0.248323 Feb 08 17:31:49.218666 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 232/446] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:48 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1752 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:49.952210 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b8d16c3b-10b6-4443-8ec7-9ec4f8f05cac tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:49.954776 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b8d16c3b-10b6-4443-8ec7-9ec4f8f05cac tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:50.001600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b8d16c3b-10b6-4443-8ec7-9ec4f8f05cac tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:50.004768 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b8d16c3b-10b6-4443-8ec7-9ec4f8f05cac tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:50.007671 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b8d16c3b-10b6-4443-8ec7-9ec4f8f05cac tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:50.012676 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b8d16c3b-10b6-4443-8ec7-9ec4f8f05cac tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:50.094092 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ff00e76f-ad10-4432-b182-e22a1c07da54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:50.094949 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ff00e76f-ad10-4432-b182-e22a1c07da54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:50.115352 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ff00e76f-ad10-4432-b182-e22a1c07da54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:50.116207 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ff00e76f-ad10-4432-b182-e22a1c07da54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:50.130612 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ff00e76f-ad10-4432-b182-e22a1c07da54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:50.134219 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ff00e76f-ad10-4432-b182-e22a1c07da54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:50.621204 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b8d16c3b-10b6-4443-8ec7-9ec4f8f05cac tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:50.665742 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b8d16c3b-10b6-4443-8ec7-9ec4f8f05cac tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.725255 Feb 08 17:31:50.669800 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 215/447] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:49 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:50.682785 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-157ac2fc-81df-4a6f-bc0d-0bc23adcf38e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:50.687026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-157ac2fc-81df-4a6f-bc0d-0bc23adcf38e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:50.700937 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-157ac2fc-81df-4a6f-bc0d-0bc23adcf38e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:50.701426 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-157ac2fc-81df-4a6f-bc0d-0bc23adcf38e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:50.702488 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-157ac2fc-81df-4a6f-bc0d-0bc23adcf38e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:50.705573 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-157ac2fc-81df-4a6f-bc0d-0bc23adcf38e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:50.746948 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ff00e76f-ad10-4432-b182-e22a1c07da54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:50.769000 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ff00e76f-ad10-4432-b182-e22a1c07da54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.679921 Feb 08 17:31:50.770160 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 233/448] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:50 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:50.794059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1876831752", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "networks": [{"uuid": "e00650e9-60fb-433d-8933-974a605223d2"}]}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:31:50.888767 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.network.neutron [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] validate_networks() for [('e00650e9-60fb-433d-8933-974a605223d2', None, None, None, None, None)] {{(pid=116480) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:31:51.266938 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-157ac2fc-81df-4a6f-bc0d-0bc23adcf38e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:51.291916 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-157ac2fc-81df-4a6f-bc0d-0bc23adcf38e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:51.294227 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-157ac2fc-81df-4a6f-bc0d-0bc23adcf38e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:51.301667 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-157ac2fc-81df-4a6f-bc0d-0bc23adcf38e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1752 microversion: 2.20 time: 0.629579 Feb 08 17:31:51.302509 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 216/449] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:50 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1752 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:51.689924 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f6cbcaca-ef9f-4850-9b54-2ea2319114d2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:51.690744 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f6cbcaca-ef9f-4850-9b54-2ea2319114d2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:51.708599 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f6cbcaca-ef9f-4850-9b54-2ea2319114d2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:51.712462 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f6cbcaca-ef9f-4850-9b54-2ea2319114d2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:51.717207 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f6cbcaca-ef9f-4850-9b54-2ea2319114d2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:51.719830 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f6cbcaca-ef9f-4850-9b54-2ea2319114d2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:51.846079 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Flavor limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:31:51.848259 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Image limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:31:51.850424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Flavor pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:31:51.851414 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Image pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:31:51.852380 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:31:51.890117 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:51.890851 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:51.892291 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:51.893063 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:51.935642 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Getting quotas for project 8bc58680f1494f0c941c254f20b7ad9f. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:31:51.943229 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Getting quotas for user b4f7c4ae54ed48e8964818e2cc18bc53 and project 8bc58680f1494f0c941c254f20b7ad9f. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:31:51.964715 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Going to run 1 instances... {{(pid=116480) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:31:51.967514 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116480) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:31:52.041140 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bb994b98-f9d8-4a9f-b115-bb8c901d4e5f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.269457 Feb 08 17:31:52.042184 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 234/450] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:31:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:31:52.049623 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-08ab7f51-47cb-4e90-b9b7-9c111d4fb839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:52.051331 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-08ab7f51-47cb-4e90-b9b7-9c111d4fb839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:52.059557 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-08ab7f51-47cb-4e90-b9b7-9c111d4fb839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:52.060506 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-08ab7f51-47cb-4e90-b9b7-9c111d4fb839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:52.061925 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-08ab7f51-47cb-4e90-b9b7-9c111d4fb839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:52.062793 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-08ab7f51-47cb-4e90-b9b7-9c111d4fb839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:52.378026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f6cbcaca-ef9f-4850-9b54-2ea2319114d2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:52.403363 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f6cbcaca-ef9f-4850-9b54-2ea2319114d2 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.717384 Feb 08 17:31:52.414463 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 217/451] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:51 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:52.424270 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8300c1af-42f1-4895-8cf0-3f9f13080ea4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:52.434780 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8300c1af-42f1-4895-8cf0-3f9f13080ea4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:52.636525 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-08ab7f51-47cb-4e90-b9b7-9c111d4fb839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:52.645885 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-08ab7f51-47cb-4e90-b9b7-9c111d4fb839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.602967 Feb 08 17:31:52.650214 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 235/452] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:52 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:52.657059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f709815a-6436-45de-ba4d-af7f33574dd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:52.675278 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f709815a-6436-45de-ba4d-af7f33574dd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:52.704581 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f709815a-6436-45de-ba4d-af7f33574dd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:52.705028 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f709815a-6436-45de-ba4d-af7f33574dd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:52.705903 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f709815a-6436-45de-ba4d-af7f33574dd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:52.706565 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f709815a-6436-45de-ba4d-af7f33574dd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:52.720889 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8300c1af-42f1-4895-8cf0-3f9f13080ea4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:52.745788 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8300c1af-42f1-4895-8cf0-3f9f13080ea4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1219 microversion: 2.1 time: 0.339742 Feb 08 17:31:52.752279 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 218/453] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:52 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1219 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:52.758421 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-0aa21984-bec7-4e10-b85e-2b2f8765b3d6 req-640e2f10-a6fb-462c-949c-53b765b210c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60934cec-9d93-4ea4-9e00-ed745313db99", "tag": "42dfed98-3788-4fc6-9076-abcd719b2bc3"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:31:52.795040 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:31:52.795040 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:31:52.823959 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-0aa21984-bec7-4e10-b85e-2b2f8765b3d6 req-640e2f10-a6fb-462c-949c-53b765b210c3 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:52.824757 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-0aa21984-bec7-4e10-b85e-2b2f8765b3d6 req-640e2f10-a6fb-462c-949c-53b765b210c3 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:52.841571 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-0aa21984-bec7-4e10-b85e-2b2f8765b3d6 req-640e2f10-a6fb-462c-949c-53b765b210c3 service nova] Creating event network-changed:42dfed98-3788-4fc6-9076-abcd719b2bc3 for instance 60934cec-9d93-4ea4-9e00-ed745313db99 on hv-cinder-82204 Feb 08 17:31:52.854217 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-0aa21984-bec7-4e10-b85e-2b2f8765b3d6 req-640e2f10-a6fb-462c-949c-53b765b210c3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095237 Feb 08 17:31:52.854890 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 219/454] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:31:53.040184 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f709815a-6436-45de-ba4d-af7f33574dd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:53.060466 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f709815a-6436-45de-ba4d-af7f33574dd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:53.064068 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f709815a-6436-45de-ba4d-af7f33574dd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:53.066437 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f709815a-6436-45de-ba4d-af7f33574dd4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1752 microversion: 2.20 time: 0.414591 Feb 08 17:31:53.067923 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 236/455] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:52 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1752 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:53.425255 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-dd38304b-486b-4d89-9321-f28658476eae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:53.426182 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-dd38304b-486b-4d89-9321-f28658476eae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:53.436811 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dd38304b-486b-4d89-9321-f28658476eae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:53.437406 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dd38304b-486b-4d89-9321-f28658476eae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:53.438105 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dd38304b-486b-4d89-9321-f28658476eae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:53.438542 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dd38304b-486b-4d89-9321-f28658476eae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:53.637496 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-dd38304b-486b-4d89-9321-f28658476eae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:53.645569 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-dd38304b-486b-4d89-9321-f28658476eae tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.225780 Feb 08 17:31:53.646174 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 220/456] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:53 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:53.678007 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-993d6856-b6dd-4807-8218-1c56370de00f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:53.678612 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-993d6856-b6dd-4807-8218-1c56370de00f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:53.690158 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-993d6856-b6dd-4807-8218-1c56370de00f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:53.690614 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-993d6856-b6dd-4807-8218-1c56370de00f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:53.691409 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-993d6856-b6dd-4807-8218-1c56370de00f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:53.691848 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-993d6856-b6dd-4807-8218-1c56370de00f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:53.771901 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-097b35f4-a2d4-4954-ba10-79cc033f8685 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:53.773719 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-097b35f4-a2d4-4954-ba10-79cc033f8685 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:53.780959 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-097b35f4-a2d4-4954-ba10-79cc033f8685 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:53.781530 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-097b35f4-a2d4-4954-ba10-79cc033f8685 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:53.782458 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-097b35f4-a2d4-4954-ba10-79cc033f8685 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:53.782894 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-097b35f4-a2d4-4954-ba10-79cc033f8685 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:53.865554 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-097b35f4-a2d4-4954-ba10-79cc033f8685 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:53.873868 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-097b35f4-a2d4-4954-ba10-79cc033f8685 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1223 microversion: 2.1 time: 0.109160 Feb 08 17:31:53.874457 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 221/457] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:53 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1223 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:53.933652 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-993d6856-b6dd-4807-8218-1c56370de00f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:53.948735 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-993d6856-b6dd-4807-8218-1c56370de00f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.274397 Feb 08 17:31:53.949698 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 237/458] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:53 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:54.096001 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b59551af-dde5-417b-92e7-4fb148760c2c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:54.098057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b59551af-dde5-417b-92e7-4fb148760c2c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:54.111226 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b59551af-dde5-417b-92e7-4fb148760c2c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:54.113493 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b59551af-dde5-417b-92e7-4fb148760c2c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:54.115319 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b59551af-dde5-417b-92e7-4fb148760c2c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:54.116552 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b59551af-dde5-417b-92e7-4fb148760c2c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:54.291707 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b59551af-dde5-417b-92e7-4fb148760c2c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:54.300785 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b59551af-dde5-417b-92e7-4fb148760c2c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:54.303004 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b59551af-dde5-417b-92e7-4fb148760c2c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:54.305454 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b59551af-dde5-417b-92e7-4fb148760c2c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1752 microversion: 2.20 time: 0.216739 Feb 08 17:31:54.306735 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 222/459] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:54 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:54.663321 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-523b25d4-e900-4fe7-a7f1-62d5c8619d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:54.664550 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-523b25d4-e900-4fe7-a7f1-62d5c8619d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:54.670425 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-523b25d4-e900-4fe7-a7f1-62d5c8619d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:54.670878 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-523b25d4-e900-4fe7-a7f1-62d5c8619d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:54.672070 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-523b25d4-e900-4fe7-a7f1-62d5c8619d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:54.672235 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-523b25d4-e900-4fe7-a7f1-62d5c8619d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:54.835491 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-523b25d4-e900-4fe7-a7f1-62d5c8619d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:54.844100 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-523b25d4-e900-4fe7-a7f1-62d5c8619d47 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.184435 Feb 08 17:31:54.845131 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 238/460] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:54 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:54.901492 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f1191e9f-f163-4213-a10a-6ec327ff9300 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:54.903107 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f1191e9f-f163-4213-a10a-6ec327ff9300 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:54.910182 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f1191e9f-f163-4213-a10a-6ec327ff9300 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:54.911000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f1191e9f-f163-4213-a10a-6ec327ff9300 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:54.912056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f1191e9f-f163-4213-a10a-6ec327ff9300 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:54.912597 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f1191e9f-f163-4213-a10a-6ec327ff9300 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:54.971984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7b5cb76f-9031-4d64-ab53-e0c64447d5ea tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:54.972602 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7b5cb76f-9031-4d64-ab53-e0c64447d5ea tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:54.986695 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f1191e9f-f163-4213-a10a-6ec327ff9300 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:54.987000 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b5cb76f-9031-4d64-ab53-e0c64447d5ea tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:54.987654 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b5cb76f-9031-4d64-ab53-e0c64447d5ea tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:54.988667 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b5cb76f-9031-4d64-ab53-e0c64447d5ea tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:54.989858 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7b5cb76f-9031-4d64-ab53-e0c64447d5ea tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:54.995536 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f1191e9f-f163-4213-a10a-6ec327ff9300 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1223 microversion: 2.1 time: 0.103536 Feb 08 17:31:54.996118 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 223/461] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:54 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:55.165778 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7b5cb76f-9031-4d64-ab53-e0c64447d5ea tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:55.176972 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7b5cb76f-9031-4d64-ab53-e0c64447d5ea tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.207184 Feb 08 17:31:55.181251 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 239/462] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:54 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:55.325083 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-75046bb9-98a8-44d5-bdf9-1e3e4bd33b14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:55.325619 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-75046bb9-98a8-44d5-bdf9-1e3e4bd33b14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:55.334148 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75046bb9-98a8-44d5-bdf9-1e3e4bd33b14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:55.336241 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75046bb9-98a8-44d5-bdf9-1e3e4bd33b14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:55.337048 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75046bb9-98a8-44d5-bdf9-1e3e4bd33b14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:55.337048 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75046bb9-98a8-44d5-bdf9-1e3e4bd33b14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:55.515856 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-75046bb9-98a8-44d5-bdf9-1e3e4bd33b14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:55.530690 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-75046bb9-98a8-44d5-bdf9-1e3e4bd33b14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:55.532876 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-75046bb9-98a8-44d5-bdf9-1e3e4bd33b14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:55.534166 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-75046bb9-98a8-44d5-bdf9-1e3e4bd33b14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1752 microversion: 2.20 time: 0.212835 Feb 08 17:31:55.534692 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 224/463] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:55 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1752 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:55.863910 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3dc92473-4570-44cd-ab25-395eb9bd71c8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:55.865708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3dc92473-4570-44cd-ab25-395eb9bd71c8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:55.875956 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3dc92473-4570-44cd-ab25-395eb9bd71c8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:55.876617 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3dc92473-4570-44cd-ab25-395eb9bd71c8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:55.877418 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3dc92473-4570-44cd-ab25-395eb9bd71c8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:55.878009 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3dc92473-4570-44cd-ab25-395eb9bd71c8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:55.906048 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:31:55.906311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: Tue Feb 8 17:31:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 (ip 10.222.0.69) !!! Feb 08 17:31:56.014373 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d3710b8d-8ed7-4260-ba56-e41fd404b1c7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:56.015012 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d3710b8d-8ed7-4260-ba56-e41fd404b1c7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:56.023477 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d3710b8d-8ed7-4260-ba56-e41fd404b1c7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:56.024597 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d3710b8d-8ed7-4260-ba56-e41fd404b1c7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:56.025848 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d3710b8d-8ed7-4260-ba56-e41fd404b1c7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:56.026993 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d3710b8d-8ed7-4260-ba56-e41fd404b1c7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:56.078779 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3dc92473-4570-44cd-ab25-395eb9bd71c8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:56.087126 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3dc92473-4570-44cd-ab25-395eb9bd71c8 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.228535 Feb 08 17:31:56.087708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 240/464] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:55 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:56.128087 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d3710b8d-8ed7-4260-ba56-e41fd404b1c7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:56.142470 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d3710b8d-8ed7-4260-ba56-e41fd404b1c7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1223 microversion: 2.1 time: 0.131391 Feb 08 17:31:56.143508 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 225/465] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:56 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1223 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:56.202156 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-125a861e-57c6-4747-b904-0da10fe10489 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:56.202840 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-125a861e-57c6-4747-b904-0da10fe10489 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:56.210489 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-125a861e-57c6-4747-b904-0da10fe10489 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:56.210935 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-125a861e-57c6-4747-b904-0da10fe10489 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:56.211807 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-125a861e-57c6-4747-b904-0da10fe10489 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:56.212309 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-125a861e-57c6-4747-b904-0da10fe10489 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:56.432695 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-125a861e-57c6-4747-b904-0da10fe10489 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:56.445421 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-125a861e-57c6-4747-b904-0da10fe10489 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.246963 Feb 08 17:31:56.446424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 241/466] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:56 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:56.552650 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a1203a26-4578-4715-8941-f95660acd2ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:56.553349 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a1203a26-4578-4715-8941-f95660acd2ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:56.560981 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a1203a26-4578-4715-8941-f95660acd2ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:56.561595 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a1203a26-4578-4715-8941-f95660acd2ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:56.562700 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a1203a26-4578-4715-8941-f95660acd2ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:56.563302 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a1203a26-4578-4715-8941-f95660acd2ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:56.758304 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a1203a26-4578-4715-8941-f95660acd2ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:56.767463 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a1203a26-4578-4715-8941-f95660acd2ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:56.768943 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a1203a26-4578-4715-8941-f95660acd2ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:56.770150 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a1203a26-4578-4715-8941-f95660acd2ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1752 microversion: 2.20 time: 0.221460 Feb 08 17:31:56.770723 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 226/467] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:56 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1752 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:31:57.104958 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-82c78534-97c7-495b-856e-089d44e73708 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:57.105977 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-82c78534-97c7-495b-856e-089d44e73708 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:57.113030 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82c78534-97c7-495b-856e-089d44e73708 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:57.113604 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82c78534-97c7-495b-856e-089d44e73708 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:57.114470 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82c78534-97c7-495b-856e-089d44e73708 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:57.114916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82c78534-97c7-495b-856e-089d44e73708 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:57.159955 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bca633f0-ff18-4dc3-9ed7-3814a831dc58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:57.160864 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-bca633f0-ff18-4dc3-9ed7-3814a831dc58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:57.168910 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bca633f0-ff18-4dc3-9ed7-3814a831dc58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:57.168910 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bca633f0-ff18-4dc3-9ed7-3814a831dc58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:57.169512 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bca633f0-ff18-4dc3-9ed7-3814a831dc58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:57.169844 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bca633f0-ff18-4dc3-9ed7-3814a831dc58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:57.268653 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bca633f0-ff18-4dc3-9ed7-3814a831dc58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:57.288623 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bca633f0-ff18-4dc3-9ed7-3814a831dc58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1223 microversion: 2.1 time: 0.132122 Feb 08 17:31:57.290606 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 227/468] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:57 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:57.344391 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-82c78534-97c7-495b-856e-089d44e73708 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:57.352651 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-82c78534-97c7-495b-856e-089d44e73708 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.252698 Feb 08 17:31:57.353254 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 242/469] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:57 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:57.475374 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-58d7454f-ddcd-4e08-97be-b3c025c68dfd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:57.476116 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-58d7454f-ddcd-4e08-97be-b3c025c68dfd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:57.482712 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-58d7454f-ddcd-4e08-97be-b3c025c68dfd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:57.483196 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-58d7454f-ddcd-4e08-97be-b3c025c68dfd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:57.484019 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-58d7454f-ddcd-4e08-97be-b3c025c68dfd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:57.484554 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-58d7454f-ddcd-4e08-97be-b3c025c68dfd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:57.663601 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-58d7454f-ddcd-4e08-97be-b3c025c68dfd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:57.679532 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-58d7454f-ddcd-4e08-97be-b3c025c68dfd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.210994 Feb 08 17:31:57.680641 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 228/470] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:57 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:57.789646 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7665c627-3ef6-4291-9a75-66065ecf107e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:57.790322 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7665c627-3ef6-4291-9a75-66065ecf107e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:57.800990 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7665c627-3ef6-4291-9a75-66065ecf107e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:57.802160 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7665c627-3ef6-4291-9a75-66065ecf107e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:57.803448 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7665c627-3ef6-4291-9a75-66065ecf107e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:57.804102 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7665c627-3ef6-4291-9a75-66065ecf107e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:57.985882 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7665c627-3ef6-4291-9a75-66065ecf107e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:57.998427 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7665c627-3ef6-4291-9a75-66065ecf107e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:57.999981 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7665c627-3ef6-4291-9a75-66065ecf107e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:58.001193 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7665c627-3ef6-4291-9a75-66065ecf107e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1752 microversion: 2.20 time: 0.216001 Feb 08 17:31:58.001902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 243/471] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:57 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:31:58.308394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7ffca2fb-ed98-4504-b0bf-6ef52e07381f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:58.309086 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7ffca2fb-ed98-4504-b0bf-6ef52e07381f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:58.318043 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7ffca2fb-ed98-4504-b0bf-6ef52e07381f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:58.318620 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7ffca2fb-ed98-4504-b0bf-6ef52e07381f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:58.319752 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7ffca2fb-ed98-4504-b0bf-6ef52e07381f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:58.320294 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7ffca2fb-ed98-4504-b0bf-6ef52e07381f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:58.374193 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8f88d940-218b-4cfb-885a-0b3b696d619c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:58.375311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8f88d940-218b-4cfb-885a-0b3b696d619c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:58.397420 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8f88d940-218b-4cfb-885a-0b3b696d619c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:58.398852 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8f88d940-218b-4cfb-885a-0b3b696d619c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:58.400290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8f88d940-218b-4cfb-885a-0b3b696d619c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:58.401277 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8f88d940-218b-4cfb-885a-0b3b696d619c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:58.434006 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-7ffca2fb-ed98-4504-b0bf-6ef52e07381f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:58.442118 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7ffca2fb-ed98-4504-b0bf-6ef52e07381f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1223 microversion: 2.1 time: 0.137311 Feb 08 17:31:58.455239 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 229/472] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:58 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1223 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:58.641514 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8f88d940-218b-4cfb-885a-0b3b696d619c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:58.652037 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8f88d940-218b-4cfb-885a-0b3b696d619c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.283923 Feb 08 17:31:58.665116 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 244/473] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:58 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:58.697332 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ed457e4f-4f68-4331-8468-11861c0357b7 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:58.697941 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ed457e4f-4f68-4331-8468-11861c0357b7 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:58.705021 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ed457e4f-4f68-4331-8468-11861c0357b7 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:58.705771 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ed457e4f-4f68-4331-8468-11861c0357b7 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:58.706851 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ed457e4f-4f68-4331-8468-11861c0357b7 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:58.707536 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ed457e4f-4f68-4331-8468-11861c0357b7 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:58.974719 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ed457e4f-4f68-4331-8468-11861c0357b7 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:58.983466 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ed457e4f-4f68-4331-8468-11861c0357b7 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.290525 Feb 08 17:31:58.984054 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 230/474] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:58 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:31:59.019580 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3532b5bd-8a1d-414e-b53c-e10dde8ef4b1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:59.020187 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3532b5bd-8a1d-414e-b53c-e10dde8ef4b1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:59.026519 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3532b5bd-8a1d-414e-b53c-e10dde8ef4b1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:59.026968 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3532b5bd-8a1d-414e-b53c-e10dde8ef4b1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:59.027841 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3532b5bd-8a1d-414e-b53c-e10dde8ef4b1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:59.028321 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3532b5bd-8a1d-414e-b53c-e10dde8ef4b1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:59.205060 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3532b5bd-8a1d-414e-b53c-e10dde8ef4b1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:59.219288 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3532b5bd-8a1d-414e-b53c-e10dde8ef4b1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:59.220805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3532b5bd-8a1d-414e-b53c-e10dde8ef4b1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:59.222005 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3532b5bd-8a1d-414e-b53c-e10dde8ef4b1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1752 microversion: 2.20 time: 0.206165 Feb 08 17:31:59.222571 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 245/475] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:31:59 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:31:59.464015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b27f1697-8b9e-456e-845d-b256aa368ec7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:59.464885 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b27f1697-8b9e-456e-845d-b256aa368ec7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:59.476033 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b27f1697-8b9e-456e-845d-b256aa368ec7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:59.476033 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b27f1697-8b9e-456e-845d-b256aa368ec7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:59.476613 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b27f1697-8b9e-456e-845d-b256aa368ec7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:59.477050 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b27f1697-8b9e-456e-845d-b256aa368ec7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:59.574957 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b27f1697-8b9e-456e-845d-b256aa368ec7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:59.583758 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b27f1697-8b9e-456e-845d-b256aa368ec7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1223 microversion: 2.1 time: 0.123836 Feb 08 17:31:59.587370 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 231/476] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:59 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:31:59.679414 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-06c938b1-1bfb-4e77-b501-064f7fb6f61c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:31:59.680555 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-06c938b1-1bfb-4e77-b501-064f7fb6f61c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:31:59.692552 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-06c938b1-1bfb-4e77-b501-064f7fb6f61c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:59.693359 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-06c938b1-1bfb-4e77-b501-064f7fb6f61c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:59.694723 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-06c938b1-1bfb-4e77-b501-064f7fb6f61c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:31:59.695485 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-06c938b1-1bfb-4e77-b501-064f7fb6f61c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:31:59.906197 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-06c938b1-1bfb-4e77-b501-064f7fb6f61c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:31:59.915154 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-06c938b1-1bfb-4e77-b501-064f7fb6f61c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.240887 Feb 08 17:31:59.916962 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 246/477] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:31:59 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:00.009521 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-69bae7a5-7bdb-42a9-af0d-225b573633e0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:00.010159 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-69bae7a5-7bdb-42a9-af0d-225b573633e0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:00.016797 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-69bae7a5-7bdb-42a9-af0d-225b573633e0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:00.017274 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-69bae7a5-7bdb-42a9-af0d-225b573633e0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:00.018088 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-69bae7a5-7bdb-42a9-af0d-225b573633e0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:00.018527 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-69bae7a5-7bdb-42a9-af0d-225b573633e0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:00.165103 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-69bae7a5-7bdb-42a9-af0d-225b573633e0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:00.173575 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-69bae7a5-7bdb-42a9-af0d-225b573633e0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.168215 Feb 08 17:32:00.174174 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 232/478] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:00 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:00.241878 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-37cf8950-9205-4b87-b10b-155a8a79419f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:00.242494 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-37cf8950-9205-4b87-b10b-155a8a79419f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:00.249635 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-37cf8950-9205-4b87-b10b-155a8a79419f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:00.250087 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-37cf8950-9205-4b87-b10b-155a8a79419f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:00.250881 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-37cf8950-9205-4b87-b10b-155a8a79419f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:00.251323 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-37cf8950-9205-4b87-b10b-155a8a79419f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:00.406848 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-37cf8950-9205-4b87-b10b-155a8a79419f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:00.423737 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-37cf8950-9205-4b87-b10b-155a8a79419f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:00.428234 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-37cf8950-9205-4b87-b10b-155a8a79419f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:00.430170 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-37cf8950-9205-4b87-b10b-155a8a79419f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1752 microversion: 2.20 time: 0.192639 Feb 08 17:32:00.431035 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 247/479] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:00 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:00.607011 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f958b802-2d51-4b4a-9036-2862126d831e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:00.608057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f958b802-2d51-4b4a-9036-2862126d831e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:00.617286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f958b802-2d51-4b4a-9036-2862126d831e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:00.618544 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f958b802-2d51-4b4a-9036-2862126d831e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:00.620834 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f958b802-2d51-4b4a-9036-2862126d831e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:00.621582 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f958b802-2d51-4b4a-9036-2862126d831e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:00.784466 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f958b802-2d51-4b4a-9036-2862126d831e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:00.798518 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f958b802-2d51-4b4a-9036-2862126d831e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1215 microversion: 2.1 time: 0.197086 Feb 08 17:32:00.800041 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 233/480] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:00 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:00.951459 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d068dc6b-030d-429a-af93-4d6cf2d48f15 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:00.952320 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d068dc6b-030d-429a-af93-4d6cf2d48f15 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:00.959395 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d068dc6b-030d-429a-af93-4d6cf2d48f15 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:00.959886 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d068dc6b-030d-429a-af93-4d6cf2d48f15 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:00.960757 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d068dc6b-030d-429a-af93-4d6cf2d48f15 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:00.961446 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d068dc6b-030d-429a-af93-4d6cf2d48f15 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:01.191431 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cbf17bf9-009c-4199-a8f7-6bad65111839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:01.193006 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-cbf17bf9-009c-4199-a8f7-6bad65111839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:01.202755 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cbf17bf9-009c-4199-a8f7-6bad65111839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:01.203124 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cbf17bf9-009c-4199-a8f7-6bad65111839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:01.203987 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cbf17bf9-009c-4199-a8f7-6bad65111839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:01.204437 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cbf17bf9-009c-4199-a8f7-6bad65111839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:01.215856 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d068dc6b-030d-429a-af93-4d6cf2d48f15 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:01.235577 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d068dc6b-030d-429a-af93-4d6cf2d48f15 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.291672 Feb 08 17:32:01.237845 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 248/481] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:00 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:01.458243 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-34ed8814-819b-4aa4-ba96-20d94aefca10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:01.464875 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-34ed8814-819b-4aa4-ba96-20d94aefca10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:01.475216 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-34ed8814-819b-4aa4-ba96-20d94aefca10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:01.476397 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-34ed8814-819b-4aa4-ba96-20d94aefca10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:01.477853 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-34ed8814-819b-4aa4-ba96-20d94aefca10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:01.478660 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-34ed8814-819b-4aa4-ba96-20d94aefca10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:01.485450 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cbf17bf9-009c-4199-a8f7-6bad65111839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:01.493769 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cbf17bf9-009c-4199-a8f7-6bad65111839 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.306531 Feb 08 17:32:01.494902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 234/482] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:01 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:01.741287 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-34ed8814-819b-4aa4-ba96-20d94aefca10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:01.755353 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-34ed8814-819b-4aa4-ba96-20d94aefca10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:01.758614 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-34ed8814-819b-4aa4-ba96-20d94aefca10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:01.760126 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-34ed8814-819b-4aa4-ba96-20d94aefca10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1754 microversion: 2.20 time: 0.312238 Feb 08 17:32:01.773863 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 249/483] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:01 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1754 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:32:01.825655 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4df6d8fd-7a0c-435f-ad7e-647533ff31bb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:01.828719 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4df6d8fd-7a0c-435f-ad7e-647533ff31bb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:01.839592 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4df6d8fd-7a0c-435f-ad7e-647533ff31bb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:01.840651 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4df6d8fd-7a0c-435f-ad7e-647533ff31bb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:01.841829 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4df6d8fd-7a0c-435f-ad7e-647533ff31bb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:01.842788 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4df6d8fd-7a0c-435f-ad7e-647533ff31bb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:01.971701 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4df6d8fd-7a0c-435f-ad7e-647533ff31bb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:01.985490 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4df6d8fd-7a0c-435f-ad7e-647533ff31bb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1277 microversion: 2.1 time: 0.168300 Feb 08 17:32:01.988915 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 235/484] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:01 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:02.255024 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3b11648e-5e49-44b9-922c-1d832fbed4ed tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:02.255639 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3b11648e-5e49-44b9-922c-1d832fbed4ed tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:02.262650 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b11648e-5e49-44b9-922c-1d832fbed4ed tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:02.263093 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b11648e-5e49-44b9-922c-1d832fbed4ed tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:02.264276 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b11648e-5e49-44b9-922c-1d832fbed4ed tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:02.264709 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b11648e-5e49-44b9-922c-1d832fbed4ed tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:02.515446 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3bbb4f75-5b8a-4478-a442-e6de03d9504d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:02.516902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3bbb4f75-5b8a-4478-a442-e6de03d9504d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:02.530825 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3bbb4f75-5b8a-4478-a442-e6de03d9504d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:02.532718 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3bbb4f75-5b8a-4478-a442-e6de03d9504d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:02.534641 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3bbb4f75-5b8a-4478-a442-e6de03d9504d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:02.535748 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3bbb4f75-5b8a-4478-a442-e6de03d9504d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:02.849673 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3b11648e-5e49-44b9-922c-1d832fbed4ed tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:02.868011 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3b11648e-5e49-44b9-922c-1d832fbed4ed tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1567 microversion: 2.1 time: 0.616293 Feb 08 17:32:02.870061 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 250/485] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:02 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1567 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:02.880504 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3bbb4f75-5b8a-4478-a442-e6de03d9504d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:02.883435 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3c33b196-86cb-4e23-a470-3c30e6f297c5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:02.884678 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3c33b196-86cb-4e23-a470-3c30e6f297c5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:02.895029 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3bbb4f75-5b8a-4478-a442-e6de03d9504d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.386151 Feb 08 17:32:02.895905 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3c33b196-86cb-4e23-a470-3c30e6f297c5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:02.896680 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3c33b196-86cb-4e23-a470-3c30e6f297c5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:02.898332 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 236/486] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:02 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:02.898713 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3c33b196-86cb-4e23-a470-3c30e6f297c5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:02.899375 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3c33b196-86cb-4e23-a470-3c30e6f297c5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:03.016132 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b69d68be-d629-4aec-8894-44f91449cdeb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:03.017584 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b69d68be-d629-4aec-8894-44f91449cdeb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:03.025807 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b69d68be-d629-4aec-8894-44f91449cdeb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:03.027286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b69d68be-d629-4aec-8894-44f91449cdeb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:03.027902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b69d68be-d629-4aec-8894-44f91449cdeb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:03.028641 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b69d68be-d629-4aec-8894-44f91449cdeb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:03.232824 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3c33b196-86cb-4e23-a470-3c30e6f297c5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:03.246572 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3c33b196-86cb-4e23-a470-3c30e6f297c5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:03.248838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3c33b196-86cb-4e23-a470-3c30e6f297c5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:03.251006 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3c33b196-86cb-4e23-a470-3c30e6f297c5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.378850 Feb 08 17:32:03.252096 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 251/487] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:02 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:03.323971 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b69d68be-d629-4aec-8894-44f91449cdeb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:03.332680 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b69d68be-d629-4aec-8894-44f91449cdeb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.323436 Feb 08 17:32:03.343080 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 237/488] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:03 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:03.662695 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-aac5641b-ad22-443b-bec9-0807a23d36ac req-ae423141-a65e-4d58-9717-a8390210bc72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3429541-40a1-4951-83df-6552bcb67e2e", "tag": "07259bed-79e4-4b11-adde-1d7572de3152"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:03.666862 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:32:03.666862 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:32:03.682557 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-aac5641b-ad22-443b-bec9-0807a23d36ac req-ae423141-a65e-4d58-9717-a8390210bc72 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:03.683209 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-aac5641b-ad22-443b-bec9-0807a23d36ac req-ae423141-a65e-4d58-9717-a8390210bc72 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:03.696743 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-aac5641b-ad22-443b-bec9-0807a23d36ac req-ae423141-a65e-4d58-9717-a8390210bc72 service nova] Creating event network-changed:07259bed-79e4-4b11-adde-1d7572de3152 for instance d3429541-40a1-4951-83df-6552bcb67e2e on hv-cinder-82204 Feb 08 17:32:03.703751 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-aac5641b-ad22-443b-bec9-0807a23d36ac req-ae423141-a65e-4d58-9717-a8390210bc72 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050857 Feb 08 17:32:03.704880 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 252/489] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:32:03.887974 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4a022197-ef67-4ca6-81ca-99f1e89329f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:03.888781 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4a022197-ef67-4ca6-81ca-99f1e89329f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:03.895884 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4a022197-ef67-4ca6-81ca-99f1e89329f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:03.896618 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4a022197-ef67-4ca6-81ca-99f1e89329f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:03.898089 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4a022197-ef67-4ca6-81ca-99f1e89329f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:03.898546 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4a022197-ef67-4ca6-81ca-99f1e89329f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:03.921176 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-94270446-0a1e-4a48-87ce-b379dd615d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:03.922707 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-94270446-0a1e-4a48-87ce-b379dd615d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:03.932203 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-94270446-0a1e-4a48-87ce-b379dd615d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:03.933091 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-94270446-0a1e-4a48-87ce-b379dd615d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:03.934429 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-94270446-0a1e-4a48-87ce-b379dd615d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:03.935285 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-94270446-0a1e-4a48-87ce-b379dd615d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:04.129079 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4a022197-ef67-4ca6-81ca-99f1e89329f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:04.142632 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4a022197-ef67-4ca6-81ca-99f1e89329f9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1547 microversion: 2.1 time: 0.258512 Feb 08 17:32:04.150789 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 238/490] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:03 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1547 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:04.179629 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-333ca6f0-765b-4690-b186-68716f1a26d7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:04.180373 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-333ca6f0-765b-4690-b186-68716f1a26d7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:04.194494 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-333ca6f0-765b-4690-b186-68716f1a26d7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:04.195340 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-333ca6f0-765b-4690-b186-68716f1a26d7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:04.196735 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-333ca6f0-765b-4690-b186-68716f1a26d7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:04.197560 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-333ca6f0-765b-4690-b186-68716f1a26d7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:04.209750 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-94270446-0a1e-4a48-87ce-b379dd615d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:04.242426 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-94270446-0a1e-4a48-87ce-b379dd615d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.326531 Feb 08 17:32:04.249183 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 253/491] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:03 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:04.285410 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8c0933f4-ee62-447e-840f-d880cb6b93fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:04.287048 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8c0933f4-ee62-447e-840f-d880cb6b93fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:04.304932 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8c0933f4-ee62-447e-840f-d880cb6b93fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:04.306569 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8c0933f4-ee62-447e-840f-d880cb6b93fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:04.308361 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8c0933f4-ee62-447e-840f-d880cb6b93fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:04.309600 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8c0933f4-ee62-447e-840f-d880cb6b93fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:04.484473 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-333ca6f0-765b-4690-b186-68716f1a26d7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] HTTP exception thrown: Cannot 'detach_volume' instance 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 while it is in vm_state rescued Feb 08 17:32:04.486068 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-333ca6f0-765b-4690-b186-68716f1a26d7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Returning 409 to user: Cannot 'detach_volume' instance 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 while it is in vm_state rescued {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:32:04.488359 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-333ca6f0-765b-4690-b186-68716f1a26d7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments/19f436e0-f47b-4e02-b21f-ee3605a2bbf6" status: 409 len: 152 microversion: 2.1 time: 0.317048 Feb 08 17:32:04.490174 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 239/492] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:32:04 2022] DELETE /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments/19f436e0-f47b-4e02-b21f-ee3605a2bbf6 => generated 152 bytes in 320 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 08 17:32:04.499750 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3de08391-f191-4e01-9bf5-41fd8bcc960e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:04.501400 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3de08391-f191-4e01-9bf5-41fd8bcc960e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:04.515225 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3de08391-f191-4e01-9bf5-41fd8bcc960e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:04.516514 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3de08391-f191-4e01-9bf5-41fd8bcc960e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:04.518505 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3de08391-f191-4e01-9bf5-41fd8bcc960e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:04.519679 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3de08391-f191-4e01-9bf5-41fd8bcc960e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:04.858358 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8c0933f4-ee62-447e-840f-d880cb6b93fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:04.877476 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8c0933f4-ee62-447e-840f-d880cb6b93fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:04.881961 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8c0933f4-ee62-447e-840f-d880cb6b93fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:04.884587 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8c0933f4-ee62-447e-840f-d880cb6b93fe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.613954 Feb 08 17:32:04.909099 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 254/493] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:04 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:04.919499 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3006c1d4-776d-4ac2-961f-8fdf90f70153 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:04.920469 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3006c1d4-776d-4ac2-961f-8fdf90f70153 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:04.933208 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3006c1d4-776d-4ac2-961f-8fdf90f70153 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:04.934009 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3006c1d4-776d-4ac2-961f-8fdf90f70153 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:04.935636 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3006c1d4-776d-4ac2-961f-8fdf90f70153 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:04.936450 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3006c1d4-776d-4ac2-961f-8fdf90f70153 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:05.072327 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3de08391-f191-4e01-9bf5-41fd8bcc960e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:05.087102 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3de08391-f191-4e01-9bf5-41fd8bcc960e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.594750 Feb 08 17:32:05.089148 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 240/494] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:04 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:05.180920 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3006c1d4-776d-4ac2-961f-8fdf90f70153 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/action" status: 202 len: 0 microversion: 2.1 time: 0.269054 Feb 08 17:32:05.182714 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 255/495] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:32:04 2022] POST /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:32:05.192759 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-27446b1f-0fc5-439c-949c-95e1ad20654c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:05.194283 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-27446b1f-0fc5-439c-949c-95e1ad20654c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:05.207485 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-27446b1f-0fc5-439c-949c-95e1ad20654c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:05.210351 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-27446b1f-0fc5-439c-949c-95e1ad20654c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:05.211543 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-27446b1f-0fc5-439c-949c-95e1ad20654c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:05.212501 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-27446b1f-0fc5-439c-949c-95e1ad20654c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:05.273641 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f7108874-191d-4c9b-afd8-e57249a5abfc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:05.274738 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f7108874-191d-4c9b-afd8-e57249a5abfc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:05.288749 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7108874-191d-4c9b-afd8-e57249a5abfc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:05.293904 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7108874-191d-4c9b-afd8-e57249a5abfc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:05.294882 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7108874-191d-4c9b-afd8-e57249a5abfc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:05.295339 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7108874-191d-4c9b-afd8-e57249a5abfc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:05.440087 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-27446b1f-0fc5-439c-949c-95e1ad20654c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:05.462442 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-27446b1f-0fc5-439c-949c-95e1ad20654c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1555 microversion: 2.1 time: 0.274182 Feb 08 17:32:05.477911 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 241/496] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:05 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1555 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:05.629558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f7108874-191d-4c9b-afd8-e57249a5abfc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:05.642533 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f7108874-191d-4c9b-afd8-e57249a5abfc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.374570 Feb 08 17:32:05.654540 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 256/497] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:05 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:05.919588 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b7681475-d53b-47d8-bb16-3797873ca580 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:05.920734 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b7681475-d53b-47d8-bb16-3797873ca580 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:05.930173 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b7681475-d53b-47d8-bb16-3797873ca580 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:05.930911 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b7681475-d53b-47d8-bb16-3797873ca580 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:05.932230 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b7681475-d53b-47d8-bb16-3797873ca580 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:05.932889 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b7681475-d53b-47d8-bb16-3797873ca580 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:06.109143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0d12b63a-441d-4657-8a1e-30e15207b6fb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:06.111338 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0d12b63a-441d-4657-8a1e-30e15207b6fb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:06.119625 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d12b63a-441d-4657-8a1e-30e15207b6fb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:06.120441 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d12b63a-441d-4657-8a1e-30e15207b6fb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:06.121505 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d12b63a-441d-4657-8a1e-30e15207b6fb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:06.122215 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d12b63a-441d-4657-8a1e-30e15207b6fb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:06.140827 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b7681475-d53b-47d8-bb16-3797873ca580 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:06.150670 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b7681475-d53b-47d8-bb16-3797873ca580 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:06.152572 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b7681475-d53b-47d8-bb16-3797873ca580 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:06.154465 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b7681475-d53b-47d8-bb16-3797873ca580 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.240813 Feb 08 17:32:06.166265 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 242/498] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:05 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:06.281718 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0d12b63a-441d-4657-8a1e-30e15207b6fb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:06.290913 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0d12b63a-441d-4657-8a1e-30e15207b6fb tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.188122 Feb 08 17:32:06.294524 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 257/499] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:06 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:06.500742 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7892d7c3-d77c-4052-9798-c7421aa0b683 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:06.502261 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7892d7c3-d77c-4052-9798-c7421aa0b683 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:06.514083 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7892d7c3-d77c-4052-9798-c7421aa0b683 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:06.514921 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7892d7c3-d77c-4052-9798-c7421aa0b683 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:06.516242 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7892d7c3-d77c-4052-9798-c7421aa0b683 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:06.517004 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7892d7c3-d77c-4052-9798-c7421aa0b683 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:06.667181 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e777103f-12f0-46c3-9b28-e1939c10bba0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:06.668458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e777103f-12f0-46c3-9b28-e1939c10bba0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:06.681385 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e777103f-12f0-46c3-9b28-e1939c10bba0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:06.682153 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e777103f-12f0-46c3-9b28-e1939c10bba0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:06.684357 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e777103f-12f0-46c3-9b28-e1939c10bba0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:06.686025 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e777103f-12f0-46c3-9b28-e1939c10bba0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:06.858581 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-7892d7c3-d77c-4052-9798-c7421aa0b683 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:06.876202 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7892d7c3-d77c-4052-9798-c7421aa0b683 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1555 microversion: 2.1 time: 0.386840 Feb 08 17:32:06.877767 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 243/500] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:06 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1555 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:06.957905 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e777103f-12f0-46c3-9b28-e1939c10bba0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:06.976370 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e777103f-12f0-46c3-9b28-e1939c10bba0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.317005 Feb 08 17:32:06.977545 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 258/501] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:06 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:07.177881 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5126dda0-7807-480b-b4d2-4c88c7a456e0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:07.179162 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5126dda0-7807-480b-b4d2-4c88c7a456e0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:07.191382 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5126dda0-7807-480b-b4d2-4c88c7a456e0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:07.192350 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5126dda0-7807-480b-b4d2-4c88c7a456e0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:07.193900 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5126dda0-7807-480b-b4d2-4c88c7a456e0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:07.194814 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5126dda0-7807-480b-b4d2-4c88c7a456e0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:07.312142 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-51a7bd46-2670-432a-a574-e6f409859e1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:07.312939 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-51a7bd46-2670-432a-a574-e6f409859e1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:07.325669 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-51a7bd46-2670-432a-a574-e6f409859e1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:07.326626 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-51a7bd46-2670-432a-a574-e6f409859e1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:07.328710 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-51a7bd46-2670-432a-a574-e6f409859e1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:07.329277 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-51a7bd46-2670-432a-a574-e6f409859e1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:07.386729 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5126dda0-7807-480b-b4d2-4c88c7a456e0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:07.401635 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5126dda0-7807-480b-b4d2-4c88c7a456e0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:07.405887 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5126dda0-7807-480b-b4d2-4c88c7a456e0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:07.406876 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5126dda0-7807-480b-b4d2-4c88c7a456e0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.235501 Feb 08 17:32:07.407908 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 244/502] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:07 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:07.539911 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-51a7bd46-2670-432a-a574-e6f409859e1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:07.553318 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-51a7bd46-2670-432a-a574-e6f409859e1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.247754 Feb 08 17:32:07.554681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 259/503] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:07 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:07.897461 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-42a4ca72-5f32-4a54-b508-fc1936db4e84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:07.898502 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-42a4ca72-5f32-4a54-b508-fc1936db4e84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:07.907138 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42a4ca72-5f32-4a54-b508-fc1936db4e84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:07.907776 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42a4ca72-5f32-4a54-b508-fc1936db4e84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:07.908901 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42a4ca72-5f32-4a54-b508-fc1936db4e84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:07.909480 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42a4ca72-5f32-4a54-b508-fc1936db4e84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:08.004172 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-407d1b0c-82c0-4819-9e1c-a2da05da24ba tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:08.004824 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-407d1b0c-82c0-4819-9e1c-a2da05da24ba tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:08.013396 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-407d1b0c-82c0-4819-9e1c-a2da05da24ba tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:08.014052 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-407d1b0c-82c0-4819-9e1c-a2da05da24ba tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:08.015559 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-407d1b0c-82c0-4819-9e1c-a2da05da24ba tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:08.016927 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-407d1b0c-82c0-4819-9e1c-a2da05da24ba tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:08.189026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-42a4ca72-5f32-4a54-b508-fc1936db4e84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:08.207321 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-42a4ca72-5f32-4a54-b508-fc1936db4e84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1555 microversion: 2.1 time: 0.316317 Feb 08 17:32:08.208481 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 245/504] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:07 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1555 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:08.326341 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-407d1b0c-82c0-4819-9e1c-a2da05da24ba tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:08.341943 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-407d1b0c-82c0-4819-9e1c-a2da05da24ba tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.346959 Feb 08 17:32:08.352740 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 260/505] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:07 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:08.434235 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8245b391-53b3-49fc-8b98-11ff2a849370 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:08.434965 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8245b391-53b3-49fc-8b98-11ff2a849370 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:08.447129 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8245b391-53b3-49fc-8b98-11ff2a849370 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:08.447841 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8245b391-53b3-49fc-8b98-11ff2a849370 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:08.448727 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8245b391-53b3-49fc-8b98-11ff2a849370 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:08.449888 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8245b391-53b3-49fc-8b98-11ff2a849370 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:08.532699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-a7c2911a-4446-48a3-aad9-00da6bb80e6d req-1f2ae440-3952-452f-a2ab-e02ac83ce5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60934cec-9d93-4ea4-9e00-ed745313db99", "name": "network-vif-plugged", "status": "completed", "tag": "42dfed98-3788-4fc6-9076-abcd719b2bc3"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:08.534460 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:32:08.534460 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:32:08.547753 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-a7c2911a-4446-48a3-aad9-00da6bb80e6d req-1f2ae440-3952-452f-a2ab-e02ac83ce5ca service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:08.548628 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-a7c2911a-4446-48a3-aad9-00da6bb80e6d req-1f2ae440-3952-452f-a2ab-e02ac83ce5ca service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:08.585544 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-a7c2911a-4446-48a3-aad9-00da6bb80e6d req-1f2ae440-3952-452f-a2ab-e02ac83ce5ca service nova] Creating event network-vif-plugged:42dfed98-3788-4fc6-9076-abcd719b2bc3 for instance 60934cec-9d93-4ea4-9e00-ed745313db99 on hv-cinder-82204 Feb 08 17:32:08.594978 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-a7c2911a-4446-48a3-aad9-00da6bb80e6d req-1f2ae440-3952-452f-a2ab-e02ac83ce5ca service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065987 Feb 08 17:32:08.596515 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 261/506] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:32:08.606520 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b9c61a0f-2c35-4cd0-af20-345e25f6b006 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:08.607723 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-b9c61a0f-2c35-4cd0-af20-345e25f6b006 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:08.634529 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b9c61a0f-2c35-4cd0-af20-345e25f6b006 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:08.636303 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b9c61a0f-2c35-4cd0-af20-345e25f6b006 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:08.637832 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b9c61a0f-2c35-4cd0-af20-345e25f6b006 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:08.640575 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b9c61a0f-2c35-4cd0-af20-345e25f6b006 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:08.669865 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8245b391-53b3-49fc-8b98-11ff2a849370 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:08.708684 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8245b391-53b3-49fc-8b98-11ff2a849370 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:08.714869 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8245b391-53b3-49fc-8b98-11ff2a849370 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:08.723096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8245b391-53b3-49fc-8b98-11ff2a849370 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.292213 Feb 08 17:32:08.726966 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 246/507] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:08 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:08.868108 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b9c61a0f-2c35-4cd0-af20-345e25f6b006 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:08.894722 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b9c61a0f-2c35-4cd0-af20-345e25f6b006 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.295904 Feb 08 17:32:08.897965 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 262/508] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:08 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:09.225338 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-fef58dd4-474a-4e67-9a15-e7993acafb42 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:09.230520 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-fef58dd4-474a-4e67-9a15-e7993acafb42 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:09.232738 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fef58dd4-474a-4e67-9a15-e7993acafb42 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:09.233250 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fef58dd4-474a-4e67-9a15-e7993acafb42 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:09.234062 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fef58dd4-474a-4e67-9a15-e7993acafb42 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:09.234964 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fef58dd4-474a-4e67-9a15-e7993acafb42 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:09.376000 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0a2447db-bcbd-4e7b-b2d4-0f2fc511a227 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:09.378168 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0a2447db-bcbd-4e7b-b2d4-0f2fc511a227 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:09.388003 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a2447db-bcbd-4e7b-b2d4-0f2fc511a227 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:09.388456 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a2447db-bcbd-4e7b-b2d4-0f2fc511a227 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:09.389279 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a2447db-bcbd-4e7b-b2d4-0f2fc511a227 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:09.389717 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0a2447db-bcbd-4e7b-b2d4-0f2fc511a227 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:09.473064 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-fef58dd4-474a-4e67-9a15-e7993acafb42 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:09.492942 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-fef58dd4-474a-4e67-9a15-e7993acafb42 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1555 microversion: 2.1 time: 0.269898 Feb 08 17:32:09.496000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 247/509] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:09 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1555 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:09.612499 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0a2447db-bcbd-4e7b-b2d4-0f2fc511a227 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:09.623647 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0a2447db-bcbd-4e7b-b2d4-0f2fc511a227 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.254218 Feb 08 17:32:09.624299 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 263/510] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:09 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:09.749448 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-caa73533-0e99-47a5-8451-d9d02e89ab14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:09.750234 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-caa73533-0e99-47a5-8451-d9d02e89ab14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:09.758244 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-caa73533-0e99-47a5-8451-d9d02e89ab14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:09.758898 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-caa73533-0e99-47a5-8451-d9d02e89ab14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:09.760225 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-caa73533-0e99-47a5-8451-d9d02e89ab14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:09.761189 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-caa73533-0e99-47a5-8451-d9d02e89ab14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:09.926603 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bf27db18-260a-4c10-aa4a-927faf6b79a5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:09.928527 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bf27db18-260a-4c10-aa4a-927faf6b79a5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:09.939158 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf27db18-260a-4c10-aa4a-927faf6b79a5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:09.939621 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf27db18-260a-4c10-aa4a-927faf6b79a5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:09.940456 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf27db18-260a-4c10-aa4a-927faf6b79a5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:09.940892 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf27db18-260a-4c10-aa4a-927faf6b79a5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:09.990899 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-caa73533-0e99-47a5-8451-d9d02e89ab14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:10.002502 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-caa73533-0e99-47a5-8451-d9d02e89ab14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:10.003896 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-caa73533-0e99-47a5-8451-d9d02e89ab14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:10.005060 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-caa73533-0e99-47a5-8451-d9d02e89ab14 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.262385 Feb 08 17:32:10.006401 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 248/511] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:09 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:10.145999 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bf27db18-260a-4c10-aa4a-927faf6b79a5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:10.159041 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bf27db18-260a-4c10-aa4a-927faf6b79a5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.241065 Feb 08 17:32:10.160049 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 264/512] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:09 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:10.522166 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8444745e-3836-455a-ae99-bf707d361ad1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:10.523051 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8444745e-3836-455a-ae99-bf707d361ad1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:10.534284 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8444745e-3836-455a-ae99-bf707d361ad1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:10.535438 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8444745e-3836-455a-ae99-bf707d361ad1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:10.537233 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8444745e-3836-455a-ae99-bf707d361ad1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:10.538288 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8444745e-3836-455a-ae99-bf707d361ad1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:10.647008 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3d7f929c-b470-4ad6-b158-a4ff09e05d29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:10.647933 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3d7f929c-b470-4ad6-b158-a4ff09e05d29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:10.660691 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3d7f929c-b470-4ad6-b158-a4ff09e05d29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:10.661722 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3d7f929c-b470-4ad6-b158-a4ff09e05d29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:10.663228 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3d7f929c-b470-4ad6-b158-a4ff09e05d29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:10.664202 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3d7f929c-b470-4ad6-b158-a4ff09e05d29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:10.770292 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8444745e-3836-455a-ae99-bf707d361ad1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:10.788146 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8444745e-3836-455a-ae99-bf707d361ad1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1555 microversion: 2.1 time: 0.271414 Feb 08 17:32:10.789898 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 249/513] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:10 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:10.891366 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3d7f929c-b470-4ad6-b158-a4ff09e05d29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:10.906175 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3d7f929c-b470-4ad6-b158-a4ff09e05d29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.264099 Feb 08 17:32:10.906839 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 265/514] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:10 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:11.028816 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0d2c7427-0d40-49de-9578-851bf1bc66de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:11.029450 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0d2c7427-0d40-49de-9578-851bf1bc66de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:11.036634 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0d2c7427-0d40-49de-9578-851bf1bc66de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:11.037279 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0d2c7427-0d40-49de-9578-851bf1bc66de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:11.038239 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0d2c7427-0d40-49de-9578-851bf1bc66de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:11.038679 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0d2c7427-0d40-49de-9578-851bf1bc66de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:11.187729 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b02abdbd-1baa-4102-a48f-277401ebcb30 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:11.188850 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-b02abdbd-1baa-4102-a48f-277401ebcb30 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:11.199204 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b02abdbd-1baa-4102-a48f-277401ebcb30 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:11.200019 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b02abdbd-1baa-4102-a48f-277401ebcb30 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:11.201550 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b02abdbd-1baa-4102-a48f-277401ebcb30 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:11.202309 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b02abdbd-1baa-4102-a48f-277401ebcb30 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:11.283709 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0d2c7427-0d40-49de-9578-851bf1bc66de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:11.312202 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0d2c7427-0d40-49de-9578-851bf1bc66de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:11.314759 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0d2c7427-0d40-49de-9578-851bf1bc66de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:11.315969 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0d2c7427-0d40-49de-9578-851bf1bc66de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.290892 Feb 08 17:32:11.316932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 250/515] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:11 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:32:11.491481 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b02abdbd-1baa-4102-a48f-277401ebcb30 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:11.503941 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b02abdbd-1baa-4102-a48f-277401ebcb30 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.322432 Feb 08 17:32:11.505434 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 266/516] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:11 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:11.813964 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-26af3d3d-7b62-45dd-a860-14be68d0fddf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:11.815550 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-26af3d3d-7b62-45dd-a860-14be68d0fddf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:11.825791 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-26af3d3d-7b62-45dd-a860-14be68d0fddf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:11.826639 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-26af3d3d-7b62-45dd-a860-14be68d0fddf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:11.827886 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-26af3d3d-7b62-45dd-a860-14be68d0fddf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:11.828593 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-26af3d3d-7b62-45dd-a860-14be68d0fddf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:11.924380 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9eef944b-69c9-4b0a-b6ea-64b0c40d267d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:11.926247 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9eef944b-69c9-4b0a-b6ea-64b0c40d267d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:11.932916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9eef944b-69c9-4b0a-b6ea-64b0c40d267d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:11.933404 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9eef944b-69c9-4b0a-b6ea-64b0c40d267d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:11.934796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9eef944b-69c9-4b0a-b6ea-64b0c40d267d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:11.935347 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9eef944b-69c9-4b0a-b6ea-64b0c40d267d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:12.048454 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-26af3d3d-7b62-45dd-a860-14be68d0fddf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:12.064397 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-26af3d3d-7b62-45dd-a860-14be68d0fddf tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1555 microversion: 2.1 time: 0.254155 Feb 08 17:32:12.065421 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 251/517] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:11 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1555 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:12.132184 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9eef944b-69c9-4b0a-b6ea-64b0c40d267d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:12.146925 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9eef944b-69c9-4b0a-b6ea-64b0c40d267d tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.225356 Feb 08 17:32:12.148318 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 267/518] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:11 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:12.342240 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-73b8dc91-4047-4041-901b-7b8631104bc3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:12.343141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-73b8dc91-4047-4041-901b-7b8631104bc3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:12.351337 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-73b8dc91-4047-4041-901b-7b8631104bc3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:12.351789 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-73b8dc91-4047-4041-901b-7b8631104bc3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:12.352594 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-73b8dc91-4047-4041-901b-7b8631104bc3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:12.353026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-73b8dc91-4047-4041-901b-7b8631104bc3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:12.529512 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0d061d39-6d04-44f8-9f65-1e0ba8cb9d2f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:12.530125 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0d061d39-6d04-44f8-9f65-1e0ba8cb9d2f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:12.542176 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d061d39-6d04-44f8-9f65-1e0ba8cb9d2f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:12.542930 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d061d39-6d04-44f8-9f65-1e0ba8cb9d2f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:12.545073 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d061d39-6d04-44f8-9f65-1e0ba8cb9d2f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:12.545902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d061d39-6d04-44f8-9f65-1e0ba8cb9d2f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:12.587681 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-73b8dc91-4047-4041-901b-7b8631104bc3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:12.600651 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-73b8dc91-4047-4041-901b-7b8631104bc3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:12.602735 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-73b8dc91-4047-4041-901b-7b8631104bc3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:12.604163 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-73b8dc91-4047-4041-901b-7b8631104bc3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.267463 Feb 08 17:32:12.605121 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 252/519] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:12 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:12.726307 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0d061d39-6d04-44f8-9f65-1e0ba8cb9d2f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:12.735368 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0d061d39-6d04-44f8-9f65-1e0ba8cb9d2f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.210603 Feb 08 17:32:12.735989 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 268/520] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:12 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:13.098105 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f02bea54-d994-4821-8cfd-ec46bdbd1c84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:13.100637 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f02bea54-d994-4821-8cfd-ec46bdbd1c84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:13.111984 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f02bea54-d994-4821-8cfd-ec46bdbd1c84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:13.112786 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f02bea54-d994-4821-8cfd-ec46bdbd1c84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:13.114315 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f02bea54-d994-4821-8cfd-ec46bdbd1c84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:13.115094 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f02bea54-d994-4821-8cfd-ec46bdbd1c84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:13.170171 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7c177401-1786-405e-ad47-4de86fd5ac13 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:13.177476 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7c177401-1786-405e-ad47-4de86fd5ac13 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:13.189348 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c177401-1786-405e-ad47-4de86fd5ac13 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:13.190863 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c177401-1786-405e-ad47-4de86fd5ac13 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:13.191551 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c177401-1786-405e-ad47-4de86fd5ac13 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:13.192335 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c177401-1786-405e-ad47-4de86fd5ac13 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:13.333089 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f02bea54-d994-4821-8cfd-ec46bdbd1c84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:13.353470 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f02bea54-d994-4821-8cfd-ec46bdbd1c84 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1555 microversion: 2.1 time: 0.265849 Feb 08 17:32:13.356473 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 253/521] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:13 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1555 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:13.470509 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7c177401-1786-405e-ad47-4de86fd5ac13 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:13.481236 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7c177401-1786-405e-ad47-4de86fd5ac13 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.316040 Feb 08 17:32:13.481236 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 269/522] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:13 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:13.630636 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-edc05ef5-e4ef-4d43-8fd4-3be049098383 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:13.631402 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-edc05ef5-e4ef-4d43-8fd4-3be049098383 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:13.642031 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-edc05ef5-e4ef-4d43-8fd4-3be049098383 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:13.642897 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-edc05ef5-e4ef-4d43-8fd4-3be049098383 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:13.644214 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-edc05ef5-e4ef-4d43-8fd4-3be049098383 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:13.645057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-edc05ef5-e4ef-4d43-8fd4-3be049098383 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:13.762254 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9fdc2d4c-1bf1-47f0-8667-e653c410befe tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:13.762773 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9fdc2d4c-1bf1-47f0-8667-e653c410befe tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:13.769244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fdc2d4c-1bf1-47f0-8667-e653c410befe tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:13.769696 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fdc2d4c-1bf1-47f0-8667-e653c410befe tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:13.770583 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fdc2d4c-1bf1-47f0-8667-e653c410befe tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:13.771607 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fdc2d4c-1bf1-47f0-8667-e653c410befe tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:13.852842 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-edc05ef5-e4ef-4d43-8fd4-3be049098383 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:13.864204 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-edc05ef5-e4ef-4d43-8fd4-3be049098383 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:13.866290 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-edc05ef5-e4ef-4d43-8fd4-3be049098383 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:13.867452 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-edc05ef5-e4ef-4d43-8fd4-3be049098383 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.243162 Feb 08 17:32:13.868374 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 254/523] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:13 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:32:13.993304 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9fdc2d4c-1bf1-47f0-8667-e653c410befe tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:14.001373 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9fdc2d4c-1bf1-47f0-8667-e653c410befe tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.243561 Feb 08 17:32:14.001954 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 270/524] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:13 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:14.380387 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8f537eeb-ea9b-4aab-8ca3-d202abd3a46e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:14.381110 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8f537eeb-ea9b-4aab-8ca3-d202abd3a46e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:14.388131 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8f537eeb-ea9b-4aab-8ca3-d202abd3a46e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:14.388579 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8f537eeb-ea9b-4aab-8ca3-d202abd3a46e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:14.389497 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8f537eeb-ea9b-4aab-8ca3-d202abd3a46e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:14.389944 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8f537eeb-ea9b-4aab-8ca3-d202abd3a46e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:14.507468 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-424d0e9d-808a-4519-8678-8ee9a7303611 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:14.508697 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-424d0e9d-808a-4519-8678-8ee9a7303611 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:14.522119 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-424d0e9d-808a-4519-8678-8ee9a7303611 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:14.523532 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-424d0e9d-808a-4519-8678-8ee9a7303611 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:14.525558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-424d0e9d-808a-4519-8678-8ee9a7303611 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:14.526797 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-424d0e9d-808a-4519-8678-8ee9a7303611 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:14.642229 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8f537eeb-ea9b-4aab-8ca3-d202abd3a46e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:14.663881 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8f537eeb-ea9b-4aab-8ca3-d202abd3a46e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1555 microversion: 2.1 time: 0.287498 Feb 08 17:32:14.665278 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 255/525] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:14 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:14.733541 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-424d0e9d-808a-4519-8678-8ee9a7303611 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:14.744023 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-424d0e9d-808a-4519-8678-8ee9a7303611 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.248944 Feb 08 17:32:14.744849 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 271/526] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:14 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:14.892836 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-64628f00-8428-49fc-afa1-03062d97abc2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:14.893700 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-64628f00-8428-49fc-afa1-03062d97abc2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:14.902533 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-64628f00-8428-49fc-afa1-03062d97abc2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:14.904065 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-64628f00-8428-49fc-afa1-03062d97abc2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:14.904409 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-64628f00-8428-49fc-afa1-03062d97abc2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:14.905043 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-64628f00-8428-49fc-afa1-03062d97abc2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:15.021560 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d6634ba4-5455-4ad1-b90f-31138519cf6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:15.022195 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d6634ba4-5455-4ad1-b90f-31138519cf6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:15.032061 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d6634ba4-5455-4ad1-b90f-31138519cf6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:15.032510 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d6634ba4-5455-4ad1-b90f-31138519cf6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:15.033347 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d6634ba4-5455-4ad1-b90f-31138519cf6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:15.033787 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d6634ba4-5455-4ad1-b90f-31138519cf6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:15.084046 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-64628f00-8428-49fc-afa1-03062d97abc2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:15.093213 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-64628f00-8428-49fc-afa1-03062d97abc2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:15.094754 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-64628f00-8428-49fc-afa1-03062d97abc2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:15.095996 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-64628f00-8428-49fc-afa1-03062d97abc2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.208712 Feb 08 17:32:15.096574 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 256/527] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:14 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:32:15.198455 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d6634ba4-5455-4ad1-b90f-31138519cf6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:15.207280 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d6634ba4-5455-4ad1-b90f-31138519cf6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.190151 Feb 08 17:32:15.207890 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 272/528] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:15 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:15.685346 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-09052e3f-ae6c-4d64-a872-a6603e2da11a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:15.687258 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-09052e3f-ae6c-4d64-a872-a6603e2da11a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:15.700070 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09052e3f-ae6c-4d64-a872-a6603e2da11a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:15.701335 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09052e3f-ae6c-4d64-a872-a6603e2da11a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:15.703449 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09052e3f-ae6c-4d64-a872-a6603e2da11a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:15.703957 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09052e3f-ae6c-4d64-a872-a6603e2da11a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:15.769060 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ff8ddc65-82d5-4eed-b648-ece71145ddad tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:15.772235 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ff8ddc65-82d5-4eed-b648-ece71145ddad tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:15.797314 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ff8ddc65-82d5-4eed-b648-ece71145ddad tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:15.797816 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ff8ddc65-82d5-4eed-b648-ece71145ddad tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:15.798656 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ff8ddc65-82d5-4eed-b648-ece71145ddad tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:15.799244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ff8ddc65-82d5-4eed-b648-ece71145ddad tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:16.096535 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ff8ddc65-82d5-4eed-b648-ece71145ddad tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:16.111596 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ff8ddc65-82d5-4eed-b648-ece71145ddad tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.349643 Feb 08 17:32:16.113059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 273/529] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:15 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:16.126569 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-23485422-a74f-4ef6-aafb-93f9afe9534e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:16.131143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-23485422-a74f-4ef6-aafb-93f9afe9534e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:16.143093 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-23485422-a74f-4ef6-aafb-93f9afe9534e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:16.144089 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-23485422-a74f-4ef6-aafb-93f9afe9534e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:16.146733 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-23485422-a74f-4ef6-aafb-93f9afe9534e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:16.146733 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-23485422-a74f-4ef6-aafb-93f9afe9534e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:16.153630 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-09052e3f-ae6c-4d64-a872-a6603e2da11a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:16.168731 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-09052e3f-ae6c-4d64-a872-a6603e2da11a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1555 microversion: 2.1 time: 0.491204 Feb 08 17:32:16.170243 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 257/530] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:15 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1555 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:16.228417 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-36546828-b541-40d5-b05e-e724b3b63ddc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:16.229727 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-36546828-b541-40d5-b05e-e724b3b63ddc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:16.239947 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-36546828-b541-40d5-b05e-e724b3b63ddc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:16.240616 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-36546828-b541-40d5-b05e-e724b3b63ddc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:16.241855 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-36546828-b541-40d5-b05e-e724b3b63ddc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:16.242513 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-36546828-b541-40d5-b05e-e724b3b63ddc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:16.343035 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-23485422-a74f-4ef6-aafb-93f9afe9534e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:16.352333 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-23485422-a74f-4ef6-aafb-93f9afe9534e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:16.354461 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-23485422-a74f-4ef6-aafb-93f9afe9534e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:16.356054 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-23485422-a74f-4ef6-aafb-93f9afe9534e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.240853 Feb 08 17:32:16.356760 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 274/531] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:16 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:16.422255 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-36546828-b541-40d5-b05e-e724b3b63ddc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:16.433706 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-36546828-b541-40d5-b05e-e724b3b63ddc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.211522 Feb 08 17:32:16.434539 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 258/532] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:16 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:17.147028 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d25b78b7-b7cc-4d5b-b1fd-4be784da6578 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:17.148454 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d25b78b7-b7cc-4d5b-b1fd-4be784da6578 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:17.157372 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d25b78b7-b7cc-4d5b-b1fd-4be784da6578 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:17.158382 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d25b78b7-b7cc-4d5b-b1fd-4be784da6578 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:17.159204 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d25b78b7-b7cc-4d5b-b1fd-4be784da6578 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:17.159659 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d25b78b7-b7cc-4d5b-b1fd-4be784da6578 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:17.201345 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1f236c25-8bc6-422c-9613-eb81021cd958 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:17.203913 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1f236c25-8bc6-422c-9613-eb81021cd958 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:17.214918 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1f236c25-8bc6-422c-9613-eb81021cd958 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:17.216020 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1f236c25-8bc6-422c-9613-eb81021cd958 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:17.217435 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1f236c25-8bc6-422c-9613-eb81021cd958 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:17.218353 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1f236c25-8bc6-422c-9613-eb81021cd958 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:17.362084 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d25b78b7-b7cc-4d5b-b1fd-4be784da6578 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:17.378987 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d25b78b7-b7cc-4d5b-b1fd-4be784da6578 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1358 microversion: 2.1 time: 0.236977 Feb 08 17:32:17.380290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 275/533] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:17 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:17.393360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-147f21db-6c71-40b9-a879-0401ed2cf97f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:17.393360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-147f21db-6c71-40b9-a879-0401ed2cf97f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:17.401421 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-147f21db-6c71-40b9-a879-0401ed2cf97f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:17.402309 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-147f21db-6c71-40b9-a879-0401ed2cf97f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:17.403542 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-147f21db-6c71-40b9-a879-0401ed2cf97f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:17.404075 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-147f21db-6c71-40b9-a879-0401ed2cf97f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:17.570103 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-147f21db-6c71-40b9-a879-0401ed2cf97f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:17.584818 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-147f21db-6c71-40b9-a879-0401ed2cf97f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:17.588916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-147f21db-6c71-40b9-a879-0401ed2cf97f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:17.591164 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-147f21db-6c71-40b9-a879-0401ed2cf97f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.204333 Feb 08 17:32:17.592137 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 276/534] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:17 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:17.600703 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2346e64c-1ec9-4e66-87a6-3b01789c5729 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:17.601584 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2346e64c-1ec9-4e66-87a6-3b01789c5729 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:17.610356 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2346e64c-1ec9-4e66-87a6-3b01789c5729 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:17.610838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2346e64c-1ec9-4e66-87a6-3b01789c5729 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:17.611720 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2346e64c-1ec9-4e66-87a6-3b01789c5729 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:17.612243 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2346e64c-1ec9-4e66-87a6-3b01789c5729 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:17.673919 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1f236c25-8bc6-422c-9613-eb81021cd958 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:17.683231 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1f236c25-8bc6-422c-9613-eb81021cd958 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1555 microversion: 2.1 time: 0.491546 Feb 08 17:32:17.684305 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 259/535] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:17 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1555 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:17.816871 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2346e64c-1ec9-4e66-87a6-3b01789c5729 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:17.826364 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2346e64c-1ec9-4e66-87a6-3b01789c5729 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.232574 Feb 08 17:32:17.827126 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 277/536] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:17 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:18.403589 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-22cd56b7-a9ca-4027-acaa-844ca6d98d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:18.404380 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-22cd56b7-a9ca-4027-acaa-844ca6d98d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:18.413811 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-22cd56b7-a9ca-4027-acaa-844ca6d98d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:18.414866 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-22cd56b7-a9ca-4027-acaa-844ca6d98d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:18.418272 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-22cd56b7-a9ca-4027-acaa-844ca6d98d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:18.418804 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-22cd56b7-a9ca-4027-acaa-844ca6d98d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:18.613476 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0f68731e-043c-45bd-86d5-9eb013ca3c7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:18.614410 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0f68731e-043c-45bd-86d5-9eb013ca3c7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:18.619721 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-22cd56b7-a9ca-4027-acaa-844ca6d98d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:18.623738 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0f68731e-043c-45bd-86d5-9eb013ca3c7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:18.624559 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0f68731e-043c-45bd-86d5-9eb013ca3c7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:18.625817 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0f68731e-043c-45bd-86d5-9eb013ca3c7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:18.626531 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0f68731e-043c-45bd-86d5-9eb013ca3c7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:18.634155 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-22cd56b7-a9ca-4027-acaa-844ca6d98d03 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1548 microversion: 2.1 time: 0.233943 Feb 08 17:32:18.635210 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 260/537] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:18 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1548 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:18.662478 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0db7a896-539b-4492-9283-ebb09a0c4f54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:18.663407 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0db7a896-539b-4492-9283-ebb09a0c4f54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:18.674040 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0db7a896-539b-4492-9283-ebb09a0c4f54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:18.674739 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0db7a896-539b-4492-9283-ebb09a0c4f54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:18.676092 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0db7a896-539b-4492-9283-ebb09a0c4f54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:18.676832 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0db7a896-539b-4492-9283-ebb09a0c4f54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:18.833395 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0f68731e-043c-45bd-86d5-9eb013ca3c7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:18.844533 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0f68731e-043c-45bd-86d5-9eb013ca3c7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:18.846537 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0f68731e-043c-45bd-86d5-9eb013ca3c7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:18.848839 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0f68731e-043c-45bd-86d5-9eb013ca3c7e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.238997 Feb 08 17:32:18.849862 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 278/538] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:18 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:32:18.855037 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0e423b77-4410-4782-bd93-e2d1233bf420 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:18.856058 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0e423b77-4410-4782-bd93-e2d1233bf420 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:18.863462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0e423b77-4410-4782-bd93-e2d1233bf420 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:18.864901 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0e423b77-4410-4782-bd93-e2d1233bf420 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:18.866022 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0e423b77-4410-4782-bd93-e2d1233bf420 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:18.866890 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0e423b77-4410-4782-bd93-e2d1233bf420 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:18.914120 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0db7a896-539b-4492-9283-ebb09a0c4f54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:18.930366 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0db7a896-539b-4492-9283-ebb09a0c4f54 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1548 microversion: 2.1 time: 0.273791 Feb 08 17:32:18.931338 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 261/539] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:18 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1548 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:18.939093 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-17ae2c68-2cb9-4c8d-85c2-5233962a672b tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:18.939997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-17ae2c68-2cb9-4c8d-85c2-5233962a672b tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:18.950724 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17ae2c68-2cb9-4c8d-85c2-5233962a672b tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:18.951392 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17ae2c68-2cb9-4c8d-85c2-5233962a672b tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:18.952617 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17ae2c68-2cb9-4c8d-85c2-5233962a672b tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:18.953339 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17ae2c68-2cb9-4c8d-85c2-5233962a672b tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:19.059311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0e423b77-4410-4782-bd93-e2d1233bf420 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:19.073699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0e423b77-4410-4782-bd93-e2d1233bf420 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1555 microversion: 2.1 time: 0.222087 Feb 08 17:32:19.074563 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 279/540] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:18 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:19.082409 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6f6c7f9c-e298-4153-bb6f-dd98ab470f90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:19.086452 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:32:19.086452 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:32:19.087467 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6f6c7f9c-e298-4153-bb6f-dd98ab470f90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:19.088207 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6f6c7f9c-e298-4153-bb6f-dd98ab470f90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Searching by: {'deleted': False, 'project_id': 'b73d5104d66948b984ce1c84170053b3'} {{(pid=116480) get_all /opt/stack/nova/nova/compute/api.py:2908}} Feb 08 17:32:19.095286 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f6c7f9c-e298-4153-bb6f-dd98ab470f90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:19.095795 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f6c7f9c-e298-4153-bb6f-dd98ab470f90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:19.096701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f6c7f9c-e298-4153-bb6f-dd98ab470f90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:19.097271 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f6c7f9c-e298-4153-bb6f-dd98ab470f90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:19.187534 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-17ae2c68-2cb9-4c8d-85c2-5233962a672b tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:19.199600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-17ae2c68-2cb9-4c8d-85c2-5233962a672b tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.266729 Feb 08 17:32:19.200600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 262/541] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:18 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:19.213916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.multi_cell_list [None req-6f6c7f9c-e298-4153-bb6f-dd98ab470f90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116480) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 08 17:32:19.321219 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6f6c7f9c-e298-4153-bb6f-dd98ab470f90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.244973 Feb 08 17:32:19.321835 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 280/542] 10.222.0.69 () {58 vars in 1124 bytes} [Tue Feb 8 17:32:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:32:19.337451 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b689107e-5c68-4d16-9348-d8e72a66b46a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:19.338578 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b689107e-5c68-4d16-9348-d8e72a66b46a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:19.349135 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b689107e-5c68-4d16-9348-d8e72a66b46a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:19.349966 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b689107e-5c68-4d16-9348-d8e72a66b46a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:19.351373 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b689107e-5c68-4d16-9348-d8e72a66b46a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:19.352133 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b689107e-5c68-4d16-9348-d8e72a66b46a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:19.551712 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b689107e-5c68-4d16-9348-d8e72a66b46a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:19.568113 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b689107e-5c68-4d16-9348-d8e72a66b46a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1548 microversion: 2.1 time: 0.235746 Feb 08 17:32:19.569195 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 263/543] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:19 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1548 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:19.875596 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-59a16b53-3ec3-4560-b881-24fc31c72517 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:19.876907 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-59a16b53-3ec3-4560-b881-24fc31c72517 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:19.888788 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-59a16b53-3ec3-4560-b881-24fc31c72517 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:19.890549 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-59a16b53-3ec3-4560-b881-24fc31c72517 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:19.891270 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-59a16b53-3ec3-4560-b881-24fc31c72517 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:19.892173 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-59a16b53-3ec3-4560-b881-24fc31c72517 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:20.093997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0562dd7d-9191-467d-9bb5-875992e63e0a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:20.094874 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0562dd7d-9191-467d-9bb5-875992e63e0a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:20.105660 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0562dd7d-9191-467d-9bb5-875992e63e0a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:20.106496 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0562dd7d-9191-467d-9bb5-875992e63e0a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:20.107599 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0562dd7d-9191-467d-9bb5-875992e63e0a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:20.108217 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0562dd7d-9191-467d-9bb5-875992e63e0a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:20.171785 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-59a16b53-3ec3-4560-b881-24fc31c72517 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:20.199776 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-59a16b53-3ec3-4560-b881-24fc31c72517 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:20.203903 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-59a16b53-3ec3-4560-b881-24fc31c72517 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:20.206245 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-59a16b53-3ec3-4560-b881-24fc31c72517 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.335028 Feb 08 17:32:20.207270 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 281/544] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:19 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:32:20.227779 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-853b24f8-8cdd-4286-b0df-fa86a28a2552 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:20.228802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-853b24f8-8cdd-4286-b0df-fa86a28a2552 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:20.236963 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-853b24f8-8cdd-4286-b0df-fa86a28a2552 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:20.237594 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-853b24f8-8cdd-4286-b0df-fa86a28a2552 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:20.238833 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-853b24f8-8cdd-4286-b0df-fa86a28a2552 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:20.239923 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-853b24f8-8cdd-4286-b0df-fa86a28a2552 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:20.385423 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0562dd7d-9191-467d-9bb5-875992e63e0a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:20.397894 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0562dd7d-9191-467d-9bb5-875992e63e0a tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1561 microversion: 2.1 time: 0.309009 Feb 08 17:32:20.398780 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 264/545] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:20 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1561 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:20.406166 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-1ebd6f86-48c5-4f40-b244-3fe69d937775 req-a0a946e4-2eb5-4f29-a28c-a1f16021e243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3429541-40a1-4951-83df-6552bcb67e2e", "name": "network-vif-plugged", "status": "completed", "tag": "07259bed-79e4-4b11-adde-1d7572de3152"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:20.409935 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:32:20.409935 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:32:20.424245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-1ebd6f86-48c5-4f40-b244-3fe69d937775 req-a0a946e4-2eb5-4f29-a28c-a1f16021e243 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:20.425608 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-1ebd6f86-48c5-4f40-b244-3fe69d937775 req-a0a946e4-2eb5-4f29-a28c-a1f16021e243 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:20.457062 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-1ebd6f86-48c5-4f40-b244-3fe69d937775 req-a0a946e4-2eb5-4f29-a28c-a1f16021e243 service nova] Creating event network-vif-plugged:07259bed-79e4-4b11-adde-1d7572de3152 for instance d3429541-40a1-4951-83df-6552bcb67e2e on hv-cinder-82204 Feb 08 17:32:20.472762 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-1ebd6f86-48c5-4f40-b244-3fe69d937775 req-a0a946e4-2eb5-4f29-a28c-a1f16021e243 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071448 Feb 08 17:32:20.475039 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 265/546] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:32:20.491329 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-853b24f8-8cdd-4286-b0df-fa86a28a2552 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:20.500631 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-853b24f8-8cdd-4286-b0df-fa86a28a2552 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.277811 Feb 08 17:32:20.511440 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 282/547] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:20 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:20.533348 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-fc1e9aff-4ef9-49cb-9909-54ab73892d8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:20.533938 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-fc1e9aff-4ef9-49cb-9909-54ab73892d8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:20.542388 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc1e9aff-4ef9-49cb-9909-54ab73892d8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:20.543162 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc1e9aff-4ef9-49cb-9909-54ab73892d8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:20.544207 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc1e9aff-4ef9-49cb-9909-54ab73892d8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:20.544848 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc1e9aff-4ef9-49cb-9909-54ab73892d8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:20.666338 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-fc1e9aff-4ef9-49cb-9909-54ab73892d8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lazy-loading 'services' on Instance uuid 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:32:20.812232 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-fc1e9aff-4ef9-49cb-9909-54ab73892d8e tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments/19f436e0-f47b-4e02-b21f-ee3605a2bbf6" status: 202 len: 0 microversion: 2.1 time: 0.283895 Feb 08 17:32:20.812959 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 266/548] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:32:20 2022] DELETE /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments/19f436e0-f47b-4e02-b21f-ee3605a2bbf6 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 17:32:20.822504 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ab9dccf2-dde4-431b-9c65-0379ee47d99c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:20.823805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ab9dccf2-dde4-431b-9c65-0379ee47d99c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:20.831514 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ab9dccf2-dde4-431b-9c65-0379ee47d99c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:20.832106 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ab9dccf2-dde4-431b-9c65-0379ee47d99c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:20.833523 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ab9dccf2-dde4-431b-9c65-0379ee47d99c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:20.834008 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ab9dccf2-dde4-431b-9c65-0379ee47d99c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:20.871655 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ab9dccf2-dde4-431b-9c65-0379ee47d99c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053270 Feb 08 17:32:20.872618 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 283/549] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:32:20 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:32:21.232711 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cd30dc6c-80ba-4563-a989-9e7f84f8e978 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:21.234223 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-cd30dc6c-80ba-4563-a989-9e7f84f8e978 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:21.255099 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cd30dc6c-80ba-4563-a989-9e7f84f8e978 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:21.256648 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cd30dc6c-80ba-4563-a989-9e7f84f8e978 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:21.257466 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cd30dc6c-80ba-4563-a989-9e7f84f8e978 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:21.258754 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cd30dc6c-80ba-4563-a989-9e7f84f8e978 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:21.428328 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c143140f-6548-4c87-9b3d-5921019e1b3a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d8f8f7e-63a2-47e3-a934-d0c0988fcfd2"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:21.430263 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c143140f-6548-4c87-9b3d-5921019e1b3a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:21.441674 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c143140f-6548-4c87-9b3d-5921019e1b3a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:21.443114 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c143140f-6548-4c87-9b3d-5921019e1b3a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:21.444510 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c143140f-6548-4c87-9b3d-5921019e1b3a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:21.445279 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c143140f-6548-4c87-9b3d-5921019e1b3a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:21.452074 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cd30dc6c-80ba-4563-a989-9e7f84f8e978 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:21.470231 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cd30dc6c-80ba-4563-a989-9e7f84f8e978 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:21.473915 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cd30dc6c-80ba-4563-a989-9e7f84f8e978 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:21.476598 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cd30dc6c-80ba-4563-a989-9e7f84f8e978 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.250002 Feb 08 17:32:21.487828 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 267/550] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:21 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:21.522308 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a4292643-0101-4837-afd5-41ea6eddd6f1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:21.523336 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a4292643-0101-4837-afd5-41ea6eddd6f1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:21.533348 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a4292643-0101-4837-afd5-41ea6eddd6f1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:21.534084 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a4292643-0101-4837-afd5-41ea6eddd6f1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:21.535756 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a4292643-0101-4837-afd5-41ea6eddd6f1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:21.536525 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a4292643-0101-4837-afd5-41ea6eddd6f1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:21.742110 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a4292643-0101-4837-afd5-41ea6eddd6f1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:21.756425 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a4292643-0101-4837-afd5-41ea6eddd6f1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1319 microversion: 2.1 time: 0.240158 Feb 08 17:32:21.757478 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 268/551] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:21 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:21.820576 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c143140f-6548-4c87-9b3d-5921019e1b3a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "POST /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399614 Feb 08 17:32:21.821623 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 284/552] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:32:21 2022] POST /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:32:21.892841 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cdeddec9-8094-4d7c-945b-d296ebae8757 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:21.894799 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-cdeddec9-8094-4d7c-945b-d296ebae8757 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:21.911385 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cdeddec9-8094-4d7c-945b-d296ebae8757 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:21.912432 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cdeddec9-8094-4d7c-945b-d296ebae8757 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:21.913710 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cdeddec9-8094-4d7c-945b-d296ebae8757 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:21.914383 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cdeddec9-8094-4d7c-945b-d296ebae8757 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:21.970659 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cdeddec9-8094-4d7c-945b-d296ebae8757 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086670 Feb 08 17:32:21.972055 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 269/553] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:32:21 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:32:22.506364 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-659d05b4-84b5-4ee6-be1a-fc743b1d78c0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:22.507598 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-659d05b4-84b5-4ee6-be1a-fc743b1d78c0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:22.519009 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-659d05b4-84b5-4ee6-be1a-fc743b1d78c0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:22.519879 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-659d05b4-84b5-4ee6-be1a-fc743b1d78c0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:22.521847 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-659d05b4-84b5-4ee6-be1a-fc743b1d78c0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:22.522633 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-659d05b4-84b5-4ee6-be1a-fc743b1d78c0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:22.778347 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-659d05b4-84b5-4ee6-be1a-fc743b1d78c0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:22.781491 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-15371b2a-7109-41fc-9fd6-ffec6d9772db tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:22.782430 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-15371b2a-7109-41fc-9fd6-ffec6d9772db tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:22.795555 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15371b2a-7109-41fc-9fd6-ffec6d9772db tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:22.796725 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15371b2a-7109-41fc-9fd6-ffec6d9772db tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:22.798361 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15371b2a-7109-41fc-9fd6-ffec6d9772db tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:22.799358 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15371b2a-7109-41fc-9fd6-ffec6d9772db tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:22.801981 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-659d05b4-84b5-4ee6-be1a-fc743b1d78c0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:22.806762 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-659d05b4-84b5-4ee6-be1a-fc743b1d78c0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:22.808979 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-659d05b4-84b5-4ee6-be1a-fc743b1d78c0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.310876 Feb 08 17:32:22.810039 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 285/554] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:22 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:22.991252 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-10b28ff4-8709-4d04-8e28-a8b4259e8aca tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:22.993790 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-10b28ff4-8709-4d04-8e28-a8b4259e8aca tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:23.007767 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-10b28ff4-8709-4d04-8e28-a8b4259e8aca tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:23.008778 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-10b28ff4-8709-4d04-8e28-a8b4259e8aca tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:23.010462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-10b28ff4-8709-4d04-8e28-a8b4259e8aca tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:23.011347 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-10b28ff4-8709-4d04-8e28-a8b4259e8aca tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:23.038640 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-15371b2a-7109-41fc-9fd6-ffec6d9772db tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:23.051939 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-15371b2a-7109-41fc-9fd6-ffec6d9772db tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1508 microversion: 2.1 time: 0.277802 Feb 08 17:32:23.052923 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 270/555] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:22 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:23.063736 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-10b28ff4-8709-4d04-8e28-a8b4259e8aca tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080516 Feb 08 17:32:23.064796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 286/556] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:32:22 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 17:32:23.833223 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bf3cc6d1-f236-4426-8604-a913d420448a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:23.834390 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-bf3cc6d1-f236-4426-8604-a913d420448a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:23.841905 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf3cc6d1-f236-4426-8604-a913d420448a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:23.842517 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf3cc6d1-f236-4426-8604-a913d420448a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:23.843459 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf3cc6d1-f236-4426-8604-a913d420448a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:23.844177 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bf3cc6d1-f236-4426-8604-a913d420448a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:24.074965 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bf3cc6d1-f236-4426-8604-a913d420448a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:24.086218 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bf3cc6d1-f236-4426-8604-a913d420448a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:24.087857 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bf3cc6d1-f236-4426-8604-a913d420448a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:24.089105 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bf3cc6d1-f236-4426-8604-a913d420448a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.260786 Feb 08 17:32:24.096774 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 271/557] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:23 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:32:25.113992 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8e071bb5-0e3e-414d-96c7-53b2ae28b12b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:25.116780 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8e071bb5-0e3e-414d-96c7-53b2ae28b12b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:25.133513 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8e071bb5-0e3e-414d-96c7-53b2ae28b12b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:25.134741 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8e071bb5-0e3e-414d-96c7-53b2ae28b12b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:25.137676 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8e071bb5-0e3e-414d-96c7-53b2ae28b12b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:25.139050 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8e071bb5-0e3e-414d-96c7-53b2ae28b12b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:25.355732 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8e071bb5-0e3e-414d-96c7-53b2ae28b12b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:25.371423 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8e071bb5-0e3e-414d-96c7-53b2ae28b12b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:25.373988 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8e071bb5-0e3e-414d-96c7-53b2ae28b12b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:25.375921 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8e071bb5-0e3e-414d-96c7-53b2ae28b12b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.269996 Feb 08 17:32:25.376861 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 287/558] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:25 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:25.564784 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-498e52c8-4bc9-492e-9168-20bf72c11efa tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:25.565658 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-498e52c8-4bc9-492e-9168-20bf72c11efa tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:25.576437 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-498e52c8-4bc9-492e-9168-20bf72c11efa tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:25.577760 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-498e52c8-4bc9-492e-9168-20bf72c11efa tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:25.578561 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-498e52c8-4bc9-492e-9168-20bf72c11efa tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:25.579252 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-498e52c8-4bc9-492e-9168-20bf72c11efa tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:25.620427 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-498e52c8-4bc9-492e-9168-20bf72c11efa tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Going to try to terminate instance {{(pid=116479) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:32:25.758565 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-498e52c8-4bc9-492e-9168-20bf72c11efa tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "DELETE /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 204 len: 0 microversion: 2.1 time: 0.199324 Feb 08 17:32:25.759597 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 272/559] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:32:25 2022] DELETE /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:32:25.773951 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-af652c28-fc98-431f-99c8-fbb314d43b89 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:25.774835 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-af652c28-fc98-431f-99c8-fbb314d43b89 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:25.785552 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-af652c28-fc98-431f-99c8-fbb314d43b89 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:25.786268 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-af652c28-fc98-431f-99c8-fbb314d43b89 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:25.787146 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-af652c28-fc98-431f-99c8-fbb314d43b89 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:25.787664 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-af652c28-fc98-431f-99c8-fbb314d43b89 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:26.031857 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-af652c28-fc98-431f-99c8-fbb314d43b89 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:26.045329 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-af652c28-fc98-431f-99c8-fbb314d43b89 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1508 microversion: 2.1 time: 0.278924 Feb 08 17:32:26.046206 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 288/560] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:25 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:26.412120 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b146c5a0-896f-44a8-b496-0447825e5d54 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:26.412917 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b146c5a0-896f-44a8-b496-0447825e5d54 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:26.423395 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b146c5a0-896f-44a8-b496-0447825e5d54 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:26.424173 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b146c5a0-896f-44a8-b496-0447825e5d54 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:26.425701 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b146c5a0-896f-44a8-b496-0447825e5d54 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:26.426955 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b146c5a0-896f-44a8-b496-0447825e5d54 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:26.642376 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b146c5a0-896f-44a8-b496-0447825e5d54 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:26.653269 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b146c5a0-896f-44a8-b496-0447825e5d54 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:26.655187 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b146c5a0-896f-44a8-b496-0447825e5d54 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:26.656441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b146c5a0-896f-44a8-b496-0447825e5d54 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.254173 Feb 08 17:32:26.657011 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 273/561] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:26 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:26.750153 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-619aef48-3c7a-48d8-825d-970b39331709 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:26.751102 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-619aef48-3c7a-48d8-825d-970b39331709 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:26.761325 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-619aef48-3c7a-48d8-825d-970b39331709 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:26.761999 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-619aef48-3c7a-48d8-825d-970b39331709 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:26.763211 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-619aef48-3c7a-48d8-825d-970b39331709 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:26.763939 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-619aef48-3c7a-48d8-825d-970b39331709 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:26.948602 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-619aef48-3c7a-48d8-825d-970b39331709 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lazy-loading 'services' on Instance uuid 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:32:27.067694 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7fb75db4-a99c-4cb3-af94-03fc9478c62f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:27.068728 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7fb75db4-a99c-4cb3-af94-03fc9478c62f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:27.083771 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7fb75db4-a99c-4cb3-af94-03fc9478c62f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:27.084602 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7fb75db4-a99c-4cb3-af94-03fc9478c62f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:27.085990 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7fb75db4-a99c-4cb3-af94-03fc9478c62f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:27.086510 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7fb75db4-a99c-4cb3-af94-03fc9478c62f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:27.113517 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-619aef48-3c7a-48d8-825d-970b39331709 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/os-volume_attachments/ced998de-d26d-49b9-8cbd-c0edaabd635c" status: 202 len: 0 microversion: 2.1 time: 0.369447 Feb 08 17:32:27.114640 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 289/562] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:32:26 2022] DELETE /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/os-volume_attachments/ced998de-d26d-49b9-8cbd-c0edaabd635c => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:32:27.324510 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-7fb75db4-a99c-4cb3-af94-03fc9478c62f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:27.336215 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7fb75db4-a99c-4cb3-af94-03fc9478c62f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1508 microversion: 2.1 time: 0.275026 Feb 08 17:32:27.337764 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 274/563] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:27 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:27.680647 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-61f0ec90-beb0-46eb-b08d-4be4e7a23f77 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:27.681875 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-61f0ec90-beb0-46eb-b08d-4be4e7a23f77 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:27.692262 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-61f0ec90-beb0-46eb-b08d-4be4e7a23f77 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:27.692948 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-61f0ec90-beb0-46eb-b08d-4be4e7a23f77 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:27.694370 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-61f0ec90-beb0-46eb-b08d-4be4e7a23f77 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:27.695049 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-61f0ec90-beb0-46eb-b08d-4be4e7a23f77 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:27.895721 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-61f0ec90-beb0-46eb-b08d-4be4e7a23f77 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:27.917374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-61f0ec90-beb0-46eb-b08d-4be4e7a23f77 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:27.920416 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-61f0ec90-beb0-46eb-b08d-4be4e7a23f77 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:27.922628 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-61f0ec90-beb0-46eb-b08d-4be4e7a23f77 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.248935 Feb 08 17:32:27.923527 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 290/564] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:27 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:32:28.362205 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-59a37842-6e48-44d2-a62d-f075238f34f6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:28.363163 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-59a37842-6e48-44d2-a62d-f075238f34f6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:28.371001 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59a37842-6e48-44d2-a62d-f075238f34f6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:28.371590 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59a37842-6e48-44d2-a62d-f075238f34f6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:28.372667 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59a37842-6e48-44d2-a62d-f075238f34f6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:28.373337 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59a37842-6e48-44d2-a62d-f075238f34f6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:28.402728 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-29132b13-5e5b-41d5-bb19-ab26b051289d req-cb8e35f0-3020-4780-98f5-4e94dfd7590d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73f173b-bae7-44a2-b686-0179e64e9c30", "name": "network-vif-plugged", "status": "completed", "tag": "72759e6a-9d50-4192-90ea-3e1d17bb4b78"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:28.407147 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:32:28.407147 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:32:28.421582 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-29132b13-5e5b-41d5-bb19-ab26b051289d req-cb8e35f0-3020-4780-98f5-4e94dfd7590d service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:28.424732 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-29132b13-5e5b-41d5-bb19-ab26b051289d req-cb8e35f0-3020-4780-98f5-4e94dfd7590d service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:28.447779 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-29132b13-5e5b-41d5-bb19-ab26b051289d req-cb8e35f0-3020-4780-98f5-4e94dfd7590d service nova] Creating event network-vif-plugged:72759e6a-9d50-4192-90ea-3e1d17bb4b78 for instance c73f173b-bae7-44a2-b686-0179e64e9c30 on hv-cinder-82204 Feb 08 17:32:28.458710 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-29132b13-5e5b-41d5-bb19-ab26b051289d req-cb8e35f0-3020-4780-98f5-4e94dfd7590d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071098 Feb 08 17:32:28.460642 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 291/565] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:32:28.660438 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-59a37842-6e48-44d2-a62d-f075238f34f6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:28.676486 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-59a37842-6e48-44d2-a62d-f075238f34f6 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1508 microversion: 2.1 time: 0.318173 Feb 08 17:32:28.677549 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 275/566] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:28 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1508 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:28.954037 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6f883492-91dc-46e1-9667-46cdf4aee22a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:28.955495 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6f883492-91dc-46e1-9667-46cdf4aee22a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:28.970745 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f883492-91dc-46e1-9667-46cdf4aee22a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:28.971635 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f883492-91dc-46e1-9667-46cdf4aee22a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:28.973293 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f883492-91dc-46e1-9667-46cdf4aee22a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:28.974229 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f883492-91dc-46e1-9667-46cdf4aee22a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:29.221582 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6f883492-91dc-46e1-9667-46cdf4aee22a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:29.237691 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6f883492-91dc-46e1-9667-46cdf4aee22a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:29.241624 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6f883492-91dc-46e1-9667-46cdf4aee22a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:29.244217 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6f883492-91dc-46e1-9667-46cdf4aee22a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.303492 Feb 08 17:32:29.245264 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 292/567] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:28 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:29.705964 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4a6c7830-fa8e-4b8a-9ba8-d908ff883c5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:29.708225 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4a6c7830-fa8e-4b8a-9ba8-d908ff883c5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:29.718314 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4a6c7830-fa8e-4b8a-9ba8-d908ff883c5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:29.718972 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4a6c7830-fa8e-4b8a-9ba8-d908ff883c5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:29.720410 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4a6c7830-fa8e-4b8a-9ba8-d908ff883c5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:29.721602 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4a6c7830-fa8e-4b8a-9ba8-d908ff883c5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:29.960881 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4a6c7830-fa8e-4b8a-9ba8-d908ff883c5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:29.974355 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4a6c7830-fa8e-4b8a-9ba8-d908ff883c5f tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1508 microversion: 2.1 time: 0.274575 Feb 08 17:32:29.974987 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 276/568] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:29 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:30.270646 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a393f3da-2df0-4823-a8e5-b2e73ef2b703 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:30.272573 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a393f3da-2df0-4823-a8e5-b2e73ef2b703 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:30.280899 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a393f3da-2df0-4823-a8e5-b2e73ef2b703 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:30.281532 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a393f3da-2df0-4823-a8e5-b2e73ef2b703 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:30.282578 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a393f3da-2df0-4823-a8e5-b2e73ef2b703 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:30.283218 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a393f3da-2df0-4823-a8e5-b2e73ef2b703 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:30.510403 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a393f3da-2df0-4823-a8e5-b2e73ef2b703 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:30.524489 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a393f3da-2df0-4823-a8e5-b2e73ef2b703 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:30.527333 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a393f3da-2df0-4823-a8e5-b2e73ef2b703 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:30.529105 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a393f3da-2df0-4823-a8e5-b2e73ef2b703 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.264453 Feb 08 17:32:30.530733 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 293/569] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:30 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:30.865775 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-021199f8-caf4-49d5-82a0-250da1b7e9e3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:30.867318 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-021199f8-caf4-49d5-82a0-250da1b7e9e3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:30.884580 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-021199f8-caf4-49d5-82a0-250da1b7e9e3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:30.885743 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-021199f8-caf4-49d5-82a0-250da1b7e9e3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:30.887302 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-021199f8-caf4-49d5-82a0-250da1b7e9e3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:30.888517 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-021199f8-caf4-49d5-82a0-250da1b7e9e3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:30.892262 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-938bc9bd-d9da-408f-97e5-43a697a02de0 req-d128bfb6-7b26-4566-94f6-faf92602f139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fe4eef-a72f-4590-8612-3fd439dd28e9", "name": "network-vif-deleted", "tag": "6abb2636-5f5b-42a8-9a24-6721d7a23d2b"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:30.896078 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:32:30.896078 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:32:30.916367 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-938bc9bd-d9da-408f-97e5-43a697a02de0 req-d128bfb6-7b26-4566-94f6-faf92602f139 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:30.917463 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-938bc9bd-d9da-408f-97e5-43a697a02de0 req-d128bfb6-7b26-4566-94f6-faf92602f139 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:30.957199 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-938bc9bd-d9da-408f-97e5-43a697a02de0 req-d128bfb6-7b26-4566-94f6-faf92602f139 service nova] Creating event network-vif-deleted:6abb2636-5f5b-42a8-9a24-6721d7a23d2b for instance 59fe4eef-a72f-4590-8612-3fd439dd28e9 on hv-cinder-82204 Feb 08 17:32:30.975689 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-938bc9bd-d9da-408f-97e5-43a697a02de0 req-d128bfb6-7b26-4566-94f6-faf92602f139 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102366 Feb 08 17:32:30.981754 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 294/570] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:32:31.000737 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e16e33b9-6e4a-4b12-a3dc-bf5a0b3fbe38 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:31.001638 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e16e33b9-6e4a-4b12-a3dc-bf5a0b3fbe38 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:31.020497 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e16e33b9-6e4a-4b12-a3dc-bf5a0b3fbe38 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:31.021195 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e16e33b9-6e4a-4b12-a3dc-bf5a0b3fbe38 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:31.022167 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e16e33b9-6e4a-4b12-a3dc-bf5a0b3fbe38 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:31.024225 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e16e33b9-6e4a-4b12-a3dc-bf5a0b3fbe38 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:31.152614 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e16e33b9-6e4a-4b12-a3dc-bf5a0b3fbe38 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:31.168709 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e16e33b9-6e4a-4b12-a3dc-bf5a0b3fbe38 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 200 len: 1293 microversion: 2.1 time: 0.175999 Feb 08 17:32:31.183462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 295/571] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:30 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 1293 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:31.186517 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-021199f8-caf4-49d5-82a0-250da1b7e9e3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:31.202934 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-021199f8-caf4-49d5-82a0-250da1b7e9e3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1594 microversion: 2.1 time: 0.343909 Feb 08 17:32:31.204258 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 277/572] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:30 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1594 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:31.554900 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-69510ced-61e3-4000-8b94-5a3efd55537a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:31.557993 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-69510ced-61e3-4000-8b94-5a3efd55537a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:31.583226 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69510ced-61e3-4000-8b94-5a3efd55537a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:31.584013 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69510ced-61e3-4000-8b94-5a3efd55537a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:31.594381 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-01701ac9-adcc-4dc6-9eaa-8ef716ff3a1a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:31.596557 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69510ced-61e3-4000-8b94-5a3efd55537a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:31.597610 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69510ced-61e3-4000-8b94-5a3efd55537a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:31.614894 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-01701ac9-adcc-4dc6-9eaa-8ef716ff3a1a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:31.617394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-01701ac9-adcc-4dc6-9eaa-8ef716ff3a1a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:31.681494 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-01701ac9-adcc-4dc6-9eaa-8ef716ff3a1a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Going to try to stop instance {{(pid=116479) force_stop /opt/stack/nova/nova/compute/api.py:2655}} Feb 08 17:32:31.781748 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-01701ac9-adcc-4dc6-9eaa-8ef716ff3a1a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "POST /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/action" status: 202 len: 0 microversion: 2.1 time: 0.194751 Feb 08 17:32:31.783385 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 278/573] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:32:31 2022] POST /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 17:32:31.799864 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-21e08019-e3e6-44b5-a9c2-84ed66685c0d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:31.801992 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-21e08019-e3e6-44b5-a9c2-84ed66685c0d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:31.812029 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-21e08019-e3e6-44b5-a9c2-84ed66685c0d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:31.812621 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-21e08019-e3e6-44b5-a9c2-84ed66685c0d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:31.813793 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-21e08019-e3e6-44b5-a9c2-84ed66685c0d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:31.820956 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-21e08019-e3e6-44b5-a9c2-84ed66685c0d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:31.900896 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-69510ced-61e3-4000-8b94-5a3efd55537a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:31.945571 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-69510ced-61e3-4000-8b94-5a3efd55537a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:31.952927 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-69510ced-61e3-4000-8b94-5a3efd55537a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:31.958674 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-69510ced-61e3-4000-8b94-5a3efd55537a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1810 microversion: 2.20 time: 0.409750 Feb 08 17:32:31.961038 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 296/574] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:31 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1810 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:32:32.200523 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-919d50fb-bb07-4d50-88d4-c02dbcb6dbd3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:32.201581 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-919d50fb-bb07-4d50-88d4-c02dbcb6dbd3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 59fe4eef-a72f-4590-8612-3fd439dd28e9] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:32.210913 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-919d50fb-bb07-4d50-88d4-c02dbcb6dbd3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:32.211362 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-919d50fb-bb07-4d50-88d4-c02dbcb6dbd3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:32.212462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-919d50fb-bb07-4d50-88d4-c02dbcb6dbd3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:32.213190 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-919d50fb-bb07-4d50-88d4-c02dbcb6dbd3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:32.231323 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-919d50fb-bb07-4d50-88d4-c02dbcb6dbd3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] HTTP exception thrown: Instance 59fe4eef-a72f-4590-8612-3fd439dd28e9 could not be found. Feb 08 17:32:32.232152 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-919d50fb-bb07-4d50-88d4-c02dbcb6dbd3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Returning 404 to user: Instance 59fe4eef-a72f-4590-8612-3fd439dd28e9 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:32:32.233399 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-919d50fb-bb07-4d50-88d4-c02dbcb6dbd3 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9" status: 404 len: 111 microversion: 2.1 time: 0.043444 Feb 08 17:32:32.234240 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 297/575] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:32 2022] GET /compute/v2.1/servers/59fe4eef-a72f-4590-8612-3fd439dd28e9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 17:32:32.244194 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-134da007-a834-44f4-bb62-65ec2b6063a9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:32.244951 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-134da007-a834-44f4-bb62-65ec2b6063a9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:32.253275 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-134da007-a834-44f4-bb62-65ec2b6063a9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:32.254046 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-134da007-a834-44f4-bb62-65ec2b6063a9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:32.255133 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-134da007-a834-44f4-bb62-65ec2b6063a9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:32.255865 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-134da007-a834-44f4-bb62-65ec2b6063a9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:32.303867 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-134da007-a834-44f4-bb62-65ec2b6063a9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:32:32.346630 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-21e08019-e3e6-44b5-a9c2-84ed66685c0d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:32.371818 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-21e08019-e3e6-44b5-a9c2-84ed66685c0d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.582049 Feb 08 17:32:32.372923 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 279/576] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:31 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:32.494227 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-134da007-a834-44f4-bb62-65ec2b6063a9 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 204 len: 0 microversion: 2.1 time: 0.253890 Feb 08 17:32:32.496308 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 298/577] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:32:32 2022] DELETE /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:32:32.509747 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1a903979-f953-497d-937d-0d1095593e68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:32.510869 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1a903979-f953-497d-937d-0d1095593e68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:32.523365 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a903979-f953-497d-937d-0d1095593e68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:32.524165 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a903979-f953-497d-937d-0d1095593e68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:32.525987 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a903979-f953-497d-937d-0d1095593e68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:32.526765 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a903979-f953-497d-937d-0d1095593e68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:32.989781 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-930fa428-3b35-4007-84e9-f13d19589de3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:32.990598 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-930fa428-3b35-4007-84e9-f13d19589de3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:33.001992 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-930fa428-3b35-4007-84e9-f13d19589de3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:33.002815 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-930fa428-3b35-4007-84e9-f13d19589de3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:33.004802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-930fa428-3b35-4007-84e9-f13d19589de3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:33.005619 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-930fa428-3b35-4007-84e9-f13d19589de3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:33.142259 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1a903979-f953-497d-937d-0d1095593e68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:33.160645 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1a903979-f953-497d-937d-0d1095593e68 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.657873 Feb 08 17:32:33.162145 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 280/578] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:32 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:33.228245 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-930fa428-3b35-4007-84e9-f13d19589de3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:33.243685 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-930fa428-3b35-4007-84e9-f13d19589de3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:33.246605 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-930fa428-3b35-4007-84e9-f13d19589de3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:33.248954 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-930fa428-3b35-4007-84e9-f13d19589de3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1797 microversion: 2.20 time: 0.263900 Feb 08 17:32:33.249984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 299/579] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:32:32 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1797 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:32:33.404987 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6c1a46c2-81a4-40d5-9a6f-f7c8e5653643 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:33.406248 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6c1a46c2-81a4-40d5-9a6f-f7c8e5653643 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:33.417534 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6c1a46c2-81a4-40d5-9a6f-f7c8e5653643 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:33.417952 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6c1a46c2-81a4-40d5-9a6f-f7c8e5653643 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:33.419211 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6c1a46c2-81a4-40d5-9a6f-f7c8e5653643 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:33.419747 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6c1a46c2-81a4-40d5-9a6f-f7c8e5653643 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:33.844771 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6c1a46c2-81a4-40d5-9a6f-f7c8e5653643 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:33.857096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6c1a46c2-81a4-40d5-9a6f-f7c8e5653643 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.458682 Feb 08 17:32:33.858104 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 281/580] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:33 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:34.193785 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-33d67eca-abd0-45d6-8033-5ea712fd5184 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:34.195191 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-33d67eca-abd0-45d6-8033-5ea712fd5184 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:34.209607 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-33d67eca-abd0-45d6-8033-5ea712fd5184 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:34.210304 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-33d67eca-abd0-45d6-8033-5ea712fd5184 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:34.212575 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-33d67eca-abd0-45d6-8033-5ea712fd5184 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:34.213852 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-33d67eca-abd0-45d6-8033-5ea712fd5184 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:34.442416 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-33d67eca-abd0-45d6-8033-5ea712fd5184 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:34.453023 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-33d67eca-abd0-45d6-8033-5ea712fd5184 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.268823 Feb 08 17:32:34.454288 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 300/581] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:34 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:34.884845 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-09620aef-fe10-454a-81b2-12e29dd13b39 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:34.886017 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-09620aef-fe10-454a-81b2-12e29dd13b39 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:34.898805 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09620aef-fe10-454a-81b2-12e29dd13b39 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:34.899631 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09620aef-fe10-454a-81b2-12e29dd13b39 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:34.901125 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09620aef-fe10-454a-81b2-12e29dd13b39 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:34.902187 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09620aef-fe10-454a-81b2-12e29dd13b39 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:34.987185 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-c49460e8-347b-4447-8e90-775bbfcf1014 req-84d3a668-48b3-4de9-b704-2cfcf0e1fe36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60934cec-9d93-4ea4-9e00-ed745313db99", "tag": "42dfed98-3788-4fc6-9076-abcd719b2bc3"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:34.991405 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:32:34.991405 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:32:35.006360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-c49460e8-347b-4447-8e90-775bbfcf1014 req-84d3a668-48b3-4de9-b704-2cfcf0e1fe36 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:35.007872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-c49460e8-347b-4447-8e90-775bbfcf1014 req-84d3a668-48b3-4de9-b704-2cfcf0e1fe36 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:35.032905 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-c49460e8-347b-4447-8e90-775bbfcf1014 req-84d3a668-48b3-4de9-b704-2cfcf0e1fe36 service nova] Creating event network-changed:42dfed98-3788-4fc6-9076-abcd719b2bc3 for instance 60934cec-9d93-4ea4-9e00-ed745313db99 on hv-cinder-82204 Feb 08 17:32:35.042459 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-c49460e8-347b-4447-8e90-775bbfcf1014 req-84d3a668-48b3-4de9-b704-2cfcf0e1fe36 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062454 Feb 08 17:32:35.043277 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 301/582] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:32:35.253453 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-09620aef-fe10-454a-81b2-12e29dd13b39 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:35.267188 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-09620aef-fe10-454a-81b2-12e29dd13b39 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.387473 Feb 08 17:32:35.282421 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 282/583] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:34 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:35.481560 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c322a876-64b3-4185-aab1-54bf6a2ab588 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:35.482797 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c322a876-64b3-4185-aab1-54bf6a2ab588 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:35.498492 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c322a876-64b3-4185-aab1-54bf6a2ab588 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:35.503435 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c322a876-64b3-4185-aab1-54bf6a2ab588 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:35.504930 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c322a876-64b3-4185-aab1-54bf6a2ab588 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:35.506342 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c322a876-64b3-4185-aab1-54bf6a2ab588 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:35.898858 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c322a876-64b3-4185-aab1-54bf6a2ab588 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:35.914958 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c322a876-64b3-4185-aab1-54bf6a2ab588 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.438411 Feb 08 17:32:35.918834 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 302/584] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:35 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:36.298198 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0877a992-8ad9-4027-93da-6e7afc159e59 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:36.300862 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0877a992-8ad9-4027-93da-6e7afc159e59 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:36.320587 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0877a992-8ad9-4027-93da-6e7afc159e59 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:36.322102 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0877a992-8ad9-4027-93da-6e7afc159e59 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:36.324067 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0877a992-8ad9-4027-93da-6e7afc159e59 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:36.325763 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0877a992-8ad9-4027-93da-6e7afc159e59 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:36.568206 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0877a992-8ad9-4027-93da-6e7afc159e59 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:36.588032 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0877a992-8ad9-4027-93da-6e7afc159e59 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.296818 Feb 08 17:32:36.606131 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 283/585] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:36 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:36.879705 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5e4e423c-239a-418a-8787-076ab6500d70 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-433200769"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:36.880754 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5e4e423c-239a-418a-8787-076ab6500d70 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:36.891617 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5e4e423c-239a-418a-8787-076ab6500d70 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:36.892450 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5e4e423c-239a-418a-8787-076ab6500d70 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:36.894468 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5e4e423c-239a-418a-8787-076ab6500d70 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:36.895279 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5e4e423c-239a-418a-8787-076ab6500d70 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:36.939888 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4d0a06c7-a538-4307-8355-d51a6f99b8ea tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:36.941676 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4d0a06c7-a538-4307-8355-d51a6f99b8ea tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:36.953131 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4d0a06c7-a538-4307-8355-d51a6f99b8ea tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:36.954062 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4d0a06c7-a538-4307-8355-d51a6f99b8ea tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:36.955521 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4d0a06c7-a538-4307-8355-d51a6f99b8ea tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:36.956874 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4d0a06c7-a538-4307-8355-d51a6f99b8ea tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:37.134758 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.network.security_group_api [None req-5e4e423c-239a-418a-8787-076ab6500d70 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Adding security group 63384b89-932d-4a52-8a75-530142e080eb to port 42dfed98-3788-4fc6-9076-abcd719b2bc3 Feb 08 17:32:37.225622 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4d0a06c7-a538-4307-8355-d51a6f99b8ea tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:37.241046 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4d0a06c7-a538-4307-8355-d51a6f99b8ea tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.307995 Feb 08 17:32:37.242709 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 284/586] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:36 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:37.627939 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1fd79d7d-ca55-4da9-80f2-30591defc2fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:37.629026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1fd79d7d-ca55-4da9-80f2-30591defc2fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:37.643869 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1fd79d7d-ca55-4da9-80f2-30591defc2fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:37.644773 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1fd79d7d-ca55-4da9-80f2-30591defc2fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:37.646206 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1fd79d7d-ca55-4da9-80f2-30591defc2fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:37.646966 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1fd79d7d-ca55-4da9-80f2-30591defc2fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:37.746904 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5e4e423c-239a-418a-8787-076ab6500d70 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "POST /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/action" status: 202 len: 0 microversion: 2.1 time: 0.873586 Feb 08 17:32:37.747518 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 303/587] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:32:36 2022] POST /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/action => generated 0 bytes in 876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:32:37.765817 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-04d5c9f0-4d4e-42ce-9209-2145605a0ada tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:37.767241 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-04d5c9f0-4d4e-42ce-9209-2145605a0ada tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:37.784759 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-04d5c9f0-4d4e-42ce-9209-2145605a0ada tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:37.785748 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-04d5c9f0-4d4e-42ce-9209-2145605a0ada tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:37.787722 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-04d5c9f0-4d4e-42ce-9209-2145605a0ada tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:37.788844 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-04d5c9f0-4d4e-42ce-9209-2145605a0ada tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:37.982538 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1fd79d7d-ca55-4da9-80f2-30591defc2fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:38.004212 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1fd79d7d-ca55-4da9-80f2-30591defc2fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.388753 Feb 08 17:32:38.005083 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 285/588] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:37 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:38.014990 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-baffce5d-6145-46e6-ab7e-b9dc23a06317 req-45d6da79-324d-48af-9189-2dfd6d92770d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60934cec-9d93-4ea4-9e00-ed745313db99", "tag": "42dfed98-3788-4fc6-9076-abcd719b2bc3"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:38.018566 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:32:38.018566 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:32:38.033279 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-baffce5d-6145-46e6-ab7e-b9dc23a06317 req-45d6da79-324d-48af-9189-2dfd6d92770d service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:38.034080 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-baffce5d-6145-46e6-ab7e-b9dc23a06317 req-45d6da79-324d-48af-9189-2dfd6d92770d service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:38.056655 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-baffce5d-6145-46e6-ab7e-b9dc23a06317 req-45d6da79-324d-48af-9189-2dfd6d92770d service nova] Creating event network-changed:42dfed98-3788-4fc6-9076-abcd719b2bc3 for instance 60934cec-9d93-4ea4-9e00-ed745313db99 on hv-cinder-82204 Feb 08 17:32:38.075888 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-baffce5d-6145-46e6-ab7e-b9dc23a06317 req-45d6da79-324d-48af-9189-2dfd6d92770d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068705 Feb 08 17:32:38.077255 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 286/589] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:32:38.169082 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-04d5c9f0-4d4e-42ce-9209-2145605a0ada tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:38.187491 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-04d5c9f0-4d4e-42ce-9209-2145605a0ada tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1758 microversion: 2.1 time: 0.432617 Feb 08 17:32:38.196495 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 304/590] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:37 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1758 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:38.270040 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c9edc678-7d06-4e51-991e-60cc17411d75 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:38.271302 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c9edc678-7d06-4e51-991e-60cc17411d75 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:38.284564 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c9edc678-7d06-4e51-991e-60cc17411d75 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:38.285428 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c9edc678-7d06-4e51-991e-60cc17411d75 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:38.286902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c9edc678-7d06-4e51-991e-60cc17411d75 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:38.287694 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c9edc678-7d06-4e51-991e-60cc17411d75 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:38.696479 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-c9edc678-7d06-4e51-991e-60cc17411d75 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:38.714515 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c9edc678-7d06-4e51-991e-60cc17411d75 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.452502 Feb 08 17:32:38.715959 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 287/591] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:38 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:39.030637 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fc5365d7-e860-4620-b953-4d7ca565f031 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:39.031411 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-fc5365d7-e860-4620-b953-4d7ca565f031 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:39.042459 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fc5365d7-e860-4620-b953-4d7ca565f031 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:39.043321 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fc5365d7-e860-4620-b953-4d7ca565f031 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:39.046579 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fc5365d7-e860-4620-b953-4d7ca565f031 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:39.046579 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fc5365d7-e860-4620-b953-4d7ca565f031 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:39.277765 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-fc5365d7-e860-4620-b953-4d7ca565f031 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:39.288816 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-fc5365d7-e860-4620-b953-4d7ca565f031 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.262409 Feb 08 17:32:39.289783 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 305/592] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:39 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:39.740364 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c145e4dc-f891-470a-9376-0b3831c29030 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:39.740963 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c145e4dc-f891-470a-9376-0b3831c29030 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:39.748863 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c145e4dc-f891-470a-9376-0b3831c29030 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:39.749429 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c145e4dc-f891-470a-9376-0b3831c29030 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:39.750297 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c145e4dc-f891-470a-9376-0b3831c29030 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:39.750925 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c145e4dc-f891-470a-9376-0b3831c29030 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:39.951318 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-c145e4dc-f891-470a-9376-0b3831c29030 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:39.960338 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c145e4dc-f891-470a-9376-0b3831c29030 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.223624 Feb 08 17:32:39.961096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 288/593] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:39 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:40.319621 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3af12301-4ba3-4ea4-a3fb-b251ac269acf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:40.320770 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3af12301-4ba3-4ea4-a3fb-b251ac269acf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:40.333017 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3af12301-4ba3-4ea4-a3fb-b251ac269acf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:40.333846 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3af12301-4ba3-4ea4-a3fb-b251ac269acf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:40.335425 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3af12301-4ba3-4ea4-a3fb-b251ac269acf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:40.336241 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3af12301-4ba3-4ea4-a3fb-b251ac269acf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:40.552796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3af12301-4ba3-4ea4-a3fb-b251ac269acf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:40.560671 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3af12301-4ba3-4ea4-a3fb-b251ac269acf tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.249386 Feb 08 17:32:40.561290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 306/594] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:40 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:40.986747 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4f2dc810-d1dd-47c1-a3f9-6338b58c20c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:40.987723 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4f2dc810-d1dd-47c1-a3f9-6338b58c20c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:40.998093 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4f2dc810-d1dd-47c1-a3f9-6338b58c20c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:40.998821 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4f2dc810-d1dd-47c1-a3f9-6338b58c20c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:41.000143 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4f2dc810-d1dd-47c1-a3f9-6338b58c20c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:41.000850 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4f2dc810-d1dd-47c1-a3f9-6338b58c20c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:41.222217 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4f2dc810-d1dd-47c1-a3f9-6338b58c20c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:41.245566 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4f2dc810-d1dd-47c1-a3f9-6338b58c20c1 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.263176 Feb 08 17:32:41.246192 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 289/595] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:40 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:41.581698 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-71178168-a260-431f-b8ea-2dbf114068ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:41.582813 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-71178168-a260-431f-b8ea-2dbf114068ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:41.592441 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71178168-a260-431f-b8ea-2dbf114068ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:41.593586 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71178168-a260-431f-b8ea-2dbf114068ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:41.594888 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71178168-a260-431f-b8ea-2dbf114068ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:41.595629 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71178168-a260-431f-b8ea-2dbf114068ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:41.786766 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-71178168-a260-431f-b8ea-2dbf114068ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:41.794711 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-71178168-a260-431f-b8ea-2dbf114068ac tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.218493 Feb 08 17:32:41.795306 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 307/596] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:41 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:42.264219 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8268bc98-9f0c-4d7e-8c93-bf1756d5815c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:42.265271 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8268bc98-9f0c-4d7e-8c93-bf1756d5815c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:42.273429 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8268bc98-9f0c-4d7e-8c93-bf1756d5815c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:42.274015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8268bc98-9f0c-4d7e-8c93-bf1756d5815c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:42.274925 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8268bc98-9f0c-4d7e-8c93-bf1756d5815c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:42.275466 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8268bc98-9f0c-4d7e-8c93-bf1756d5815c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:42.802248 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8268bc98-9f0c-4d7e-8c93-bf1756d5815c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:42.816029 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8268bc98-9f0c-4d7e-8c93-bf1756d5815c tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1521 microversion: 2.1 time: 0.555683 Feb 08 17:32:42.817622 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 290/597] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:42 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1521 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:42.822745 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c3fb1d19-f9c9-4cff-88b1-549e1b92daf6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:42.823955 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c3fb1d19-f9c9-4cff-88b1-549e1b92daf6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:42.834940 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c3fb1d19-f9c9-4cff-88b1-549e1b92daf6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:42.835671 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c3fb1d19-f9c9-4cff-88b1-549e1b92daf6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:42.837223 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c3fb1d19-f9c9-4cff-88b1-549e1b92daf6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:42.837823 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c3fb1d19-f9c9-4cff-88b1-549e1b92daf6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:43.050046 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c3fb1d19-f9c9-4cff-88b1-549e1b92daf6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:43.062158 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c3fb1d19-f9c9-4cff-88b1-549e1b92daf6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.252950 Feb 08 17:32:43.063145 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 308/598] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:42 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:43.162683 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-392604ec-0a14-4d21-bc79-3ff861446ce1 req-49ddf276-d378-4b10-b7dd-a553672623e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3008c9c2-fd0b-4740-9eac-4b0cecaaf870", "name": "network-vif-deleted", "tag": "31b3853a-c848-4c47-9011-d681d4245eae"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:43.164221 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:32:43.164221 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:32:43.171762 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-392604ec-0a14-4d21-bc79-3ff861446ce1 req-49ddf276-d378-4b10-b7dd-a553672623e3 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:43.172252 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-392604ec-0a14-4d21-bc79-3ff861446ce1 req-49ddf276-d378-4b10-b7dd-a553672623e3 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:43.190010 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-392604ec-0a14-4d21-bc79-3ff861446ce1 req-49ddf276-d378-4b10-b7dd-a553672623e3 service nova] Creating event network-vif-deleted:31b3853a-c848-4c47-9011-d681d4245eae for instance 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 on hv-cinder-82204 Feb 08 17:32:43.196070 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-392604ec-0a14-4d21-bc79-3ff861446ce1 req-49ddf276-d378-4b10-b7dd-a553672623e3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037639 Feb 08 17:32:43.197056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 291/599] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:32:43.840741 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-011f5459-4fd2-404b-8942-60324d4179f7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:43.841633 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-011f5459-4fd2-404b-8942-60324d4179f7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:43.853742 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-011f5459-4fd2-404b-8942-60324d4179f7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:43.854470 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-011f5459-4fd2-404b-8942-60324d4179f7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:43.855810 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-011f5459-4fd2-404b-8942-60324d4179f7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:43.856423 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-011f5459-4fd2-404b-8942-60324d4179f7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:43.902188 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-011f5459-4fd2-404b-8942-60324d4179f7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:43.902905 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-011f5459-4fd2-404b-8942-60324d4179f7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:43.903693 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-011f5459-4fd2-404b-8942-60324d4179f7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lazy-loading 'fault' on Instance uuid 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:32:43.961021 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-011f5459-4fd2-404b-8942-60324d4179f7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17e28d06d6b4f72b850d5cc0f983f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80022e131af94dfb9d6069b7d0492189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:43.969065 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-011f5459-4fd2-404b-8942-60324d4179f7 tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 200 len: 1311 microversion: 2.1 time: 0.135134 Feb 08 17:32:43.969711 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 309/600] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:43 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 1311 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:44.091580 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b8ae2a58-0494-401e-8cf6-305812f0fb16 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:44.092242 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b8ae2a58-0494-401e-8cf6-305812f0fb16 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:44.102115 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b8ae2a58-0494-401e-8cf6-305812f0fb16 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:44.102830 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b8ae2a58-0494-401e-8cf6-305812f0fb16 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:44.103834 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b8ae2a58-0494-401e-8cf6-305812f0fb16 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:44.104579 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b8ae2a58-0494-401e-8cf6-305812f0fb16 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:44.280438 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b8ae2a58-0494-401e-8cf6-305812f0fb16 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:44.297562 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b8ae2a58-0494-401e-8cf6-305812f0fb16 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.211187 Feb 08 17:32:44.298185 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 292/601] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:44 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:44.994664 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-747b99fb-524e-4bd3-9d39-472da903f0ef tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:44.995537 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-747b99fb-524e-4bd3-9d39-472da903f0ef tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] [instance: 3008c9c2-fd0b-4740-9eac-4b0cecaaf870] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:45.003229 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-747b99fb-524e-4bd3-9d39-472da903f0ef tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:45.003736 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-747b99fb-524e-4bd3-9d39-472da903f0ef tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:45.004546 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-747b99fb-524e-4bd3-9d39-472da903f0ef tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:45.004978 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-747b99fb-524e-4bd3-9d39-472da903f0ef tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:45.027355 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-747b99fb-524e-4bd3-9d39-472da903f0ef tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] HTTP exception thrown: Instance 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 could not be found. Feb 08 17:32:45.027952 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-747b99fb-524e-4bd3-9d39-472da903f0ef tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] Returning 404 to user: Instance 3008c9c2-fd0b-4740-9eac-4b0cecaaf870 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:32:45.028830 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-747b99fb-524e-4bd3-9d39-472da903f0ef tempest-ServerRescueNegativeTestJSON-1653111515 tempest-ServerRescueNegativeTestJSON-1653111515-project] 10.222.0.69 "GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870" status: 404 len: 111 microversion: 2.1 time: 0.039061 Feb 08 17:32:45.029458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 310/602] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:44 2022] GET /compute/v2.1/servers/3008c9c2-fd0b-4740-9eac-4b0cecaaf870 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:32:45.318641 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bb3b42a9-e67d-4414-b96c-7ede4d80c226 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:45.319503 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-bb3b42a9-e67d-4414-b96c-7ede4d80c226 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:45.327471 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bb3b42a9-e67d-4414-b96c-7ede4d80c226 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:45.328001 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bb3b42a9-e67d-4414-b96c-7ede4d80c226 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:45.329062 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bb3b42a9-e67d-4414-b96c-7ede4d80c226 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:45.330052 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bb3b42a9-e67d-4414-b96c-7ede4d80c226 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:45.593386 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bb3b42a9-e67d-4414-b96c-7ede4d80c226 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:45.607939 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bb3b42a9-e67d-4414-b96c-7ede4d80c226 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.295198 Feb 08 17:32:45.609030 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 293/603] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:45 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:46.639338 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d8459428-ba02-4cdc-b60e-6c52ffcd4665 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:46.639961 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d8459428-ba02-4cdc-b60e-6c52ffcd4665 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:46.647982 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d8459428-ba02-4cdc-b60e-6c52ffcd4665 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:46.648557 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d8459428-ba02-4cdc-b60e-6c52ffcd4665 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:46.649708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d8459428-ba02-4cdc-b60e-6c52ffcd4665 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:46.650570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d8459428-ba02-4cdc-b60e-6c52ffcd4665 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:46.824751 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d8459428-ba02-4cdc-b60e-6c52ffcd4665 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:46.836320 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d8459428-ba02-4cdc-b60e-6c52ffcd4665 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1676 microversion: 2.1 time: 0.202945 Feb 08 17:32:46.837382 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 311/604] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:46 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1676 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:47.860681 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ffae3c6c-b7c2-4538-a7b4-0b82529ed1d4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:47.862328 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ffae3c6c-b7c2-4538-a7b4-0b82529ed1d4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:47.873363 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ffae3c6c-b7c2-4538-a7b4-0b82529ed1d4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:47.874574 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ffae3c6c-b7c2-4538-a7b4-0b82529ed1d4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:47.876243 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ffae3c6c-b7c2-4538-a7b4-0b82529ed1d4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:47.877825 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ffae3c6c-b7c2-4538-a7b4-0b82529ed1d4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:48.093776 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ffae3c6c-b7c2-4538-a7b4-0b82529ed1d4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:48.107916 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ffae3c6c-b7c2-4538-a7b4-0b82529ed1d4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1653 microversion: 2.1 time: 0.254283 Feb 08 17:32:48.109136 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 294/605] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:47 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1653 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:48.129628 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-577f2a7e-42cb-46cf-a235-d8b4c591171e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:48.136811 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-577f2a7e-42cb-46cf-a235-d8b4c591171e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:48.137320 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-577f2a7e-42cb-46cf-a235-d8b4c591171e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:48.163588 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-577f2a7e-42cb-46cf-a235-d8b4c591171e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Going to try to start instance {{(pid=116480) start /opt/stack/nova/nova/compute/api.py:2678}} Feb 08 17:32:48.214374 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-577f2a7e-42cb-46cf-a235-d8b4c591171e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "POST /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/action" status: 202 len: 0 microversion: 2.1 time: 0.088047 Feb 08 17:32:48.215801 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 312/606] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:32:48 2022] POST /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 17:32:48.233108 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-66e2e311-2b94-4255-be1d-9fded5352826 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:48.234283 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-66e2e311-2b94-4255-be1d-9fded5352826 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:48.246350 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-66e2e311-2b94-4255-be1d-9fded5352826 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:48.247057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-66e2e311-2b94-4255-be1d-9fded5352826 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:48.248619 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-66e2e311-2b94-4255-be1d-9fded5352826 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:48.249410 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-66e2e311-2b94-4255-be1d-9fded5352826 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:48.467918 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-66e2e311-2b94-4255-be1d-9fded5352826 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:48.476545 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-66e2e311-2b94-4255-be1d-9fded5352826 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1662 microversion: 2.1 time: 0.252523 Feb 08 17:32:48.477180 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 295/607] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:48 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1662 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:48.670369 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6ac35c0c-d9f1-48f2-96c0-3c7effd5e1e2 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eac646dc-65a0-4efc-af9d-1c2e0393bed5", "device": "/dev/sdb"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:48.672646 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6ac35c0c-d9f1-48f2-96c0-3c7effd5e1e2 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:48.679010 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6ac35c0c-d9f1-48f2-96c0-3c7effd5e1e2 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:48.679469 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6ac35c0c-d9f1-48f2-96c0-3c7effd5e1e2 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:48.680301 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6ac35c0c-d9f1-48f2-96c0-3c7effd5e1e2 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:48.680837 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6ac35c0c-d9f1-48f2-96c0-3c7effd5e1e2 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:49.041423 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6ac35c0c-d9f1-48f2-96c0-3c7effd5e1e2 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "POST /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375230 Feb 08 17:32:49.042347 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 313/608] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:32:48 2022] POST /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:32:49.502512 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-825a2bc4-9a2f-4839-bab8-48750b226fe1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:49.503792 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-825a2bc4-9a2f-4839-bab8-48750b226fe1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:49.515928 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-825a2bc4-9a2f-4839-bab8-48750b226fe1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:49.516429 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-825a2bc4-9a2f-4839-bab8-48750b226fe1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:49.518341 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-825a2bc4-9a2f-4839-bab8-48750b226fe1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:49.519435 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-825a2bc4-9a2f-4839-bab8-48750b226fe1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:49.799696 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-825a2bc4-9a2f-4839-bab8-48750b226fe1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:49.818150 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-825a2bc4-9a2f-4839-bab8-48750b226fe1 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1662 microversion: 2.1 time: 0.321938 Feb 08 17:32:49.819168 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 296/609] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:49 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1662 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:50.842837 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a81bfcdf-a2b0-4003-9a06-65b04005bf7d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:50.844119 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a81bfcdf-a2b0-4003-9a06-65b04005bf7d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:50.853218 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a81bfcdf-a2b0-4003-9a06-65b04005bf7d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:50.853752 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a81bfcdf-a2b0-4003-9a06-65b04005bf7d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:50.854603 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a81bfcdf-a2b0-4003-9a06-65b04005bf7d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:50.855104 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a81bfcdf-a2b0-4003-9a06-65b04005bf7d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:51.033175 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a81bfcdf-a2b0-4003-9a06-65b04005bf7d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:51.041517 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a81bfcdf-a2b0-4003-9a06-65b04005bf7d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1666 microversion: 2.1 time: 0.207383 Feb 08 17:32:51.042093 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 314/610] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:50 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1666 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:52.270807 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-449157619", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "networks": [{"uuid": "68303811-987d-45d3-911c-ea578153745e"}]}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:52.351622 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.network.neutron [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] validate_networks() for [('68303811-987d-45d3-911c-ea578153745e', None, None, None, None, None)] {{(pid=116479) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:32:53.063418 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Flavor limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:32:53.064414 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Image limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:32:53.065110 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Flavor pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:32:53.065427 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Image pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:32:53.065856 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:32:53.078434 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:53.078891 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:53.079888 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:53.080381 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:53.098096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Getting quotas for project 74eb713ad3e34829a512ab7b068613e4. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:32:53.102880 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Getting quotas for user 4ecb87afe54d4389b8177a3570088e67 and project 74eb713ad3e34829a512ab7b068613e4. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:32:53.117727 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Going to run 1 instances... {{(pid=116479) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:32:53.120478 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:32:53.178030 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f2fdae21-c478-4173-8ce6-cd533f0fb311 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051923 Feb 08 17:32:53.178685 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 297/611] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:32:53.192324 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e7d6afc9-d495-4792-a872-3c53c279eacf tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:53.193906 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e7d6afc9-d495-4792-a872-3c53c279eacf tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:53.276305 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e7d6afc9-d495-4792-a872-3c53c279eacf tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:53.285949 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e7d6afc9-d495-4792-a872-3c53c279eacf tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1217 microversion: 2.1 time: 0.100556 Feb 08 17:32:53.286632 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 315/612] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:53 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:54.303861 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8a7486b0-eb29-489d-8b31-6a156f347157 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:54.304547 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8a7486b0-eb29-489d-8b31-6a156f347157 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:54.311215 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8a7486b0-eb29-489d-8b31-6a156f347157 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:54.311676 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8a7486b0-eb29-489d-8b31-6a156f347157 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:54.312489 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8a7486b0-eb29-489d-8b31-6a156f347157 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:54.312924 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8a7486b0-eb29-489d-8b31-6a156f347157 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:54.411915 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8a7486b0-eb29-489d-8b31-6a156f347157 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:54.422014 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8a7486b0-eb29-489d-8b31-6a156f347157 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1269 microversion: 2.1 time: 0.122488 Feb 08 17:32:54.423361 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 298/613] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:54 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1269 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:32:55.446317 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9070966f-d383-4698-ac59-8cf4cc1c1c08 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:55.447416 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9070966f-d383-4698-ac59-8cf4cc1c1c08 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:55.460626 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9070966f-d383-4698-ac59-8cf4cc1c1c08 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:55.461377 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9070966f-d383-4698-ac59-8cf4cc1c1c08 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:55.463719 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9070966f-d383-4698-ac59-8cf4cc1c1c08 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:55.464551 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9070966f-d383-4698-ac59-8cf4cc1c1c08 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:55.656865 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9070966f-d383-4698-ac59-8cf4cc1c1c08 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:55.677316 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9070966f-d383-4698-ac59-8cf4cc1c1c08 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.239498 Feb 08 17:32:55.687997 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 316/614] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:55 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:56.270260 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-82a2d3a9-3b50-4324-9d8a-4b58ec63e0ce req-cd2e20c4-f6b5-4354-bec1-772fd7443f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1c405c-8f1a-49d0-a128-67027dae51ed", "tag": "777433bc-e1f2-41da-b7c6-8abca55ae19d"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:32:56.272049 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:32:56.272049 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:32:56.283862 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-82a2d3a9-3b50-4324-9d8a-4b58ec63e0ce req-cd2e20c4-f6b5-4354-bec1-772fd7443f73 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:56.285010 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-82a2d3a9-3b50-4324-9d8a-4b58ec63e0ce req-cd2e20c4-f6b5-4354-bec1-772fd7443f73 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:56.314451 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-82a2d3a9-3b50-4324-9d8a-4b58ec63e0ce req-cd2e20c4-f6b5-4354-bec1-772fd7443f73 service nova] Creating event network-changed:777433bc-e1f2-41da-b7c6-8abca55ae19d for instance 9e1c405c-8f1a-49d0-a128-67027dae51ed on hv-cinder-82204 Feb 08 17:32:56.324617 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-82a2d3a9-3b50-4324-9d8a-4b58ec63e0ce req-cd2e20c4-f6b5-4354-bec1-772fd7443f73 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059133 Feb 08 17:32:56.325912 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 299/615] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:32:56.703056 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-58464d07-06e7-4f92-9624-09039dc5cfee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:56.705031 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-58464d07-06e7-4f92-9624-09039dc5cfee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:56.715829 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-58464d07-06e7-4f92-9624-09039dc5cfee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:56.716637 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-58464d07-06e7-4f92-9624-09039dc5cfee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:56.718190 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-58464d07-06e7-4f92-9624-09039dc5cfee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:56.718945 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-58464d07-06e7-4f92-9624-09039dc5cfee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:56.943314 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-58464d07-06e7-4f92-9624-09039dc5cfee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:56.954375 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-58464d07-06e7-4f92-9624-09039dc5cfee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.256550 Feb 08 17:32:56.955132 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 317/616] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:56 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:57.980176 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bfc36ac8-88c2-4e39-9d89-620647736b06 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:57.980889 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-bfc36ac8-88c2-4e39-9d89-620647736b06 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:57.991347 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bfc36ac8-88c2-4e39-9d89-620647736b06 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:57.992055 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bfc36ac8-88c2-4e39-9d89-620647736b06 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:57.993406 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bfc36ac8-88c2-4e39-9d89-620647736b06 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:57.994107 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bfc36ac8-88c2-4e39-9d89-620647736b06 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:58.175309 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-bfc36ac8-88c2-4e39-9d89-620647736b06 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:58.185325 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bfc36ac8-88c2-4e39-9d89-620647736b06 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.210544 Feb 08 17:32:58.185932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 300/617] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:57 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:32:59.203564 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f3fd2edd-06f3-4685-aa1e-49141a909b05 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:32:59.204442 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f3fd2edd-06f3-4685-aa1e-49141a909b05 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:32:59.211195 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f3fd2edd-06f3-4685-aa1e-49141a909b05 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:59.211844 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f3fd2edd-06f3-4685-aa1e-49141a909b05 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:59.212812 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f3fd2edd-06f3-4685-aa1e-49141a909b05 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:32:59.213303 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f3fd2edd-06f3-4685-aa1e-49141a909b05 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:32:59.396965 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f3fd2edd-06f3-4685-aa1e-49141a909b05 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:32:59.405298 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f3fd2edd-06f3-4685-aa1e-49141a909b05 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.206506 Feb 08 17:32:59.406028 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 318/618] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:32:59 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:00.426789 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d3105068-1abd-4d35-ba65-d299937e424f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:00.427710 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d3105068-1abd-4d35-ba65-d299937e424f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:00.439895 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d3105068-1abd-4d35-ba65-d299937e424f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:00.440671 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d3105068-1abd-4d35-ba65-d299937e424f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:00.442105 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d3105068-1abd-4d35-ba65-d299937e424f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:00.442870 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d3105068-1abd-4d35-ba65-d299937e424f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:00.613020 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d3105068-1abd-4d35-ba65-d299937e424f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:00.622715 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d3105068-1abd-4d35-ba65-d299937e424f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.202711 Feb 08 17:33:00.623385 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 301/619] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:00 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:01.644663 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-24b216e1-f37e-4868-98ce-896f602d1260 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:01.645497 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-24b216e1-f37e-4868-98ce-896f602d1260 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:01.653931 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24b216e1-f37e-4868-98ce-896f602d1260 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:01.654457 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24b216e1-f37e-4868-98ce-896f602d1260 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:01.655224 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24b216e1-f37e-4868-98ce-896f602d1260 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:01.655663 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-24b216e1-f37e-4868-98ce-896f602d1260 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:01.809485 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-24b216e1-f37e-4868-98ce-896f602d1260 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:01.817955 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-24b216e1-f37e-4868-98ce-896f602d1260 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.177834 Feb 08 17:33:01.818820 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 319/620] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:01 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:02.835875 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f6b08da5-03c5-49e7-a943-a46ae4d5e766 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:02.836564 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f6b08da5-03c5-49e7-a943-a46ae4d5e766 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:02.843141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f6b08da5-03c5-49e7-a943-a46ae4d5e766 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:02.843584 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f6b08da5-03c5-49e7-a943-a46ae4d5e766 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:02.844377 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f6b08da5-03c5-49e7-a943-a46ae4d5e766 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:02.844815 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f6b08da5-03c5-49e7-a943-a46ae4d5e766 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:03.003525 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f6b08da5-03c5-49e7-a943-a46ae4d5e766 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:03.011097 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f6b08da5-03c5-49e7-a943-a46ae4d5e766 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.178947 Feb 08 17:33:03.011679 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 302/621] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:02 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:04.027774 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d53b940f-7d42-488c-ba70-f787feab5132 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:04.028423 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d53b940f-7d42-488c-ba70-f787feab5132 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:04.034802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d53b940f-7d42-488c-ba70-f787feab5132 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:04.035264 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d53b940f-7d42-488c-ba70-f787feab5132 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:04.036064 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d53b940f-7d42-488c-ba70-f787feab5132 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:04.036680 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d53b940f-7d42-488c-ba70-f787feab5132 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:04.179475 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d53b940f-7d42-488c-ba70-f787feab5132 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:04.187180 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d53b940f-7d42-488c-ba70-f787feab5132 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.162986 Feb 08 17:33:04.187758 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 320/622] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:04 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:05.204673 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8766b3e7-aae8-48d7-828e-9186264cfc90 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:05.205339 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8766b3e7-aae8-48d7-828e-9186264cfc90 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:05.214230 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8766b3e7-aae8-48d7-828e-9186264cfc90 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:05.214867 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8766b3e7-aae8-48d7-828e-9186264cfc90 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:05.215830 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8766b3e7-aae8-48d7-828e-9186264cfc90 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:05.216717 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8766b3e7-aae8-48d7-828e-9186264cfc90 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:05.372243 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8766b3e7-aae8-48d7-828e-9186264cfc90 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:05.379850 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8766b3e7-aae8-48d7-828e-9186264cfc90 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.178817 Feb 08 17:33:05.380436 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 303/623] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:05 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:06.397045 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3b37ccef-afa3-49be-b5e1-da8d8ce06977 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:06.398143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3b37ccef-afa3-49be-b5e1-da8d8ce06977 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:06.406397 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b37ccef-afa3-49be-b5e1-da8d8ce06977 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:06.407006 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b37ccef-afa3-49be-b5e1-da8d8ce06977 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:06.408059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b37ccef-afa3-49be-b5e1-da8d8ce06977 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:06.408608 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b37ccef-afa3-49be-b5e1-da8d8ce06977 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:06.618802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3b37ccef-afa3-49be-b5e1-da8d8ce06977 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:06.627355 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3b37ccef-afa3-49be-b5e1-da8d8ce06977 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.234989 Feb 08 17:33:06.627938 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 321/624] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:06 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:07.038129 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-c1f11d2a-8619-4b95-ac90-629216e0d6c5 req-e2d83c33-13ce-4520-b989-d31b846fef74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1c405c-8f1a-49d0-a128-67027dae51ed", "name": "network-vif-plugged", "status": "completed", "tag": "777433bc-e1f2-41da-b7c6-8abca55ae19d"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:07.039745 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:33:07.039745 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:33:07.047689 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-c1f11d2a-8619-4b95-ac90-629216e0d6c5 req-e2d83c33-13ce-4520-b989-d31b846fef74 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:07.048312 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-c1f11d2a-8619-4b95-ac90-629216e0d6c5 req-e2d83c33-13ce-4520-b989-d31b846fef74 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:07.062073 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-c1f11d2a-8619-4b95-ac90-629216e0d6c5 req-e2d83c33-13ce-4520-b989-d31b846fef74 service nova] Creating event network-vif-plugged:777433bc-e1f2-41da-b7c6-8abca55ae19d for instance 9e1c405c-8f1a-49d0-a128-67027dae51ed on hv-cinder-82204 Feb 08 17:33:07.067533 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-c1f11d2a-8619-4b95-ac90-629216e0d6c5 req-e2d83c33-13ce-4520-b989-d31b846fef74 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033056 Feb 08 17:33:07.068556 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 304/625] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:33:07.654496 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-05bbe91f-f40c-4b64-bf75-f89ef53d46da tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:07.655111 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-05bbe91f-f40c-4b64-bf75-f89ef53d46da tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:07.661728 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-05bbe91f-f40c-4b64-bf75-f89ef53d46da tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:07.662259 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-05bbe91f-f40c-4b64-bf75-f89ef53d46da tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:07.663062 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-05bbe91f-f40c-4b64-bf75-f89ef53d46da tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:07.663500 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-05bbe91f-f40c-4b64-bf75-f89ef53d46da tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:07.822783 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-05bbe91f-f40c-4b64-bf75-f89ef53d46da tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:07.830629 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-05bbe91f-f40c-4b64-bf75-f89ef53d46da tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.179765 Feb 08 17:33:07.831216 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 322/626] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:07 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:08.859062 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-616a7954-9d8e-40dd-b010-d761b80a7e97 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:08.860334 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-616a7954-9d8e-40dd-b010-d761b80a7e97 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:08.867689 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-616a7954-9d8e-40dd-b010-d761b80a7e97 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:08.868136 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-616a7954-9d8e-40dd-b010-d761b80a7e97 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:08.868953 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-616a7954-9d8e-40dd-b010-d761b80a7e97 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:08.869486 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-616a7954-9d8e-40dd-b010-d761b80a7e97 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:09.086510 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-616a7954-9d8e-40dd-b010-d761b80a7e97 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:09.099539 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-616a7954-9d8e-40dd-b010-d761b80a7e97 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.245922 Feb 08 17:33:09.100533 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 305/627] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:08 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:10.122059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d2c343bc-47ed-4108-84d3-34524e15a70c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:10.124782 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d2c343bc-47ed-4108-84d3-34524e15a70c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:10.137482 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2c343bc-47ed-4108-84d3-34524e15a70c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:10.138619 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2c343bc-47ed-4108-84d3-34524e15a70c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:10.141050 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2c343bc-47ed-4108-84d3-34524e15a70c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:10.141823 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2c343bc-47ed-4108-84d3-34524e15a70c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:10.363323 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d2c343bc-47ed-4108-84d3-34524e15a70c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:10.379700 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d2c343bc-47ed-4108-84d3-34524e15a70c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1317 microversion: 2.1 time: 0.264067 Feb 08 17:33:10.380705 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 323/628] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:10 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:11.404923 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-da1a383b-3e98-4634-a87a-95a5cf13e913 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:11.406005 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-da1a383b-3e98-4634-a87a-95a5cf13e913 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:11.413345 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-da1a383b-3e98-4634-a87a-95a5cf13e913 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:11.413834 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-da1a383b-3e98-4634-a87a-95a5cf13e913 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:11.414859 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-da1a383b-3e98-4634-a87a-95a5cf13e913 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:11.415364 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-da1a383b-3e98-4634-a87a-95a5cf13e913 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:11.601247 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-da1a383b-3e98-4634-a87a-95a5cf13e913 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:11.610099 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-da1a383b-3e98-4634-a87a-95a5cf13e913 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1505 microversion: 2.1 time: 0.210109 Feb 08 17:33:11.610693 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 306/629] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:11 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:13.074225 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-48360761-426a-47de-9b4f-b8d70805725b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6af56e2b-d473-492b-98f5-6e2f51b0b40f"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:13.075499 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-48360761-426a-47de-9b4f-b8d70805725b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:13.083149 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-48360761-426a-47de-9b4f-b8d70805725b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:13.083750 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-48360761-426a-47de-9b4f-b8d70805725b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:13.084552 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-48360761-426a-47de-9b4f-b8d70805725b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:13.085010 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-48360761-426a-47de-9b4f-b8d70805725b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:13.215083 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b2fa95e3-4c31-46ff-81f7-117deeb658d4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:13.215890 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b2fa95e3-4c31-46ff-81f7-117deeb658d4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:13.223199 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b2fa95e3-4c31-46ff-81f7-117deeb658d4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:13.223638 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b2fa95e3-4c31-46ff-81f7-117deeb658d4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:13.224847 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b2fa95e3-4c31-46ff-81f7-117deeb658d4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:13.225875 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b2fa95e3-4c31-46ff-81f7-117deeb658d4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:13.328944 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-b2fa95e3-4c31-46ff-81f7-117deeb658d4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lazy-loading 'services' on Instance uuid d3429541-40a1-4951-83df-6552bcb67e2e {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:33:13.376883 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-48360761-426a-47de-9b4f-b8d70805725b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "POST /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307035 Feb 08 17:33:13.377891 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 324/630] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:33:13 2022] POST /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:33:13.432581 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b2fa95e3-4c31-46ff-81f7-117deeb658d4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e/os-volume_attachments/eac646dc-65a0-4efc-af9d-1c2e0393bed5" status: 202 len: 0 microversion: 2.1 time: 0.221501 Feb 08 17:33:13.433278 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 307/631] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:33:13 2022] DELETE /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e/os-volume_attachments/eac646dc-65a0-4efc-af9d-1c2e0393bed5 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 17:33:21.023736 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f6d82ce4-8ad8-4806-bfda-d94bceddbaed tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:21.024530 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f6d82ce4-8ad8-4806-bfda-d94bceddbaed tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:21.031443 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f6d82ce4-8ad8-4806-bfda-d94bceddbaed tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:21.031902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f6d82ce4-8ad8-4806-bfda-d94bceddbaed tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:21.032778 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f6d82ce4-8ad8-4806-bfda-d94bceddbaed tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:21.033239 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f6d82ce4-8ad8-4806-bfda-d94bceddbaed tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:21.086647 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f6d82ce4-8ad8-4806-bfda-d94bceddbaed tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:33:21.127584 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-748363613", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "networks": [{"uuid": "68303811-987d-45d3-911c-ea578153745e"}]}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:21.186606 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f6d82ce4-8ad8-4806-bfda-d94bceddbaed tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 204 len: 0 microversion: 2.1 time: 0.166960 Feb 08 17:33:21.187923 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 325/632] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:33:21 2022] DELETE /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 08 17:33:21.197577 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-89f3ee49-3668-4c23-95ca-0d5fe9d52ae7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:21.198405 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-89f3ee49-3668-4c23-95ca-0d5fe9d52ae7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:21.205794 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.network.neutron [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] validate_networks() for [('68303811-987d-45d3-911c-ea578153745e', None, None, None, None, None)] {{(pid=116479) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:33:21.206232 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89f3ee49-3668-4c23-95ca-0d5fe9d52ae7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:21.206805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89f3ee49-3668-4c23-95ca-0d5fe9d52ae7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:21.207684 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89f3ee49-3668-4c23-95ca-0d5fe9d52ae7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:21.208163 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89f3ee49-3668-4c23-95ca-0d5fe9d52ae7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:21.406438 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-89f3ee49-3668-4c23-95ca-0d5fe9d52ae7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:21.419897 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-89f3ee49-3668-4c23-95ca-0d5fe9d52ae7 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1514 microversion: 2.1 time: 0.226872 Feb 08 17:33:21.420575 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 326/633] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:21 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:21.720312 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Flavor limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:33:21.720814 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Image limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:33:21.721337 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Flavor pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:33:21.722047 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Image pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:33:21.722795 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:33:21.736336 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:21.737022 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:21.738443 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:21.739158 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:21.761200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Getting quotas for project 74eb713ad3e34829a512ab7b068613e4. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:33:21.766463 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Getting quotas for user 4ecb87afe54d4389b8177a3570088e67 and project 74eb713ad3e34829a512ab7b068613e4. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:33:21.783736 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Going to run 1 instances... {{(pid=116479) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:33:21.788298 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:33:21.863323 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b0c5f71f-1cc3-4add-93e0-1133780de4d9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744060 Feb 08 17:33:21.869539 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 308/634] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:33:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 08 17:33:21.879462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f5c9722a-3a14-4a1a-a39d-c86856f11926 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:21.880446 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f5c9722a-3a14-4a1a-a39d-c86856f11926 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:21.956928 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f5c9722a-3a14-4a1a-a39d-c86856f11926 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:21.971698 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f5c9722a-3a14-4a1a-a39d-c86856f11926 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1217 microversion: 2.1 time: 0.097507 Feb 08 17:33:21.974217 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 327/635] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:21 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:22.447314 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2d115c8a-3222-4038-9b70-3a467f8e2625 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:22.447919 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2d115c8a-3222-4038-9b70-3a467f8e2625 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:22.455226 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2d115c8a-3222-4038-9b70-3a467f8e2625 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:22.455680 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2d115c8a-3222-4038-9b70-3a467f8e2625 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:22.456846 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2d115c8a-3222-4038-9b70-3a467f8e2625 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:22.457407 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2d115c8a-3222-4038-9b70-3a467f8e2625 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:22.662088 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2d115c8a-3222-4038-9b70-3a467f8e2625 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:22.674462 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2d115c8a-3222-4038-9b70-3a467f8e2625 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1514 microversion: 2.1 time: 0.230492 Feb 08 17:33:22.675538 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 309/636] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:22 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:22.994247 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-25574ecd-a8d6-4524-a826-3298b1d07791 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:22.995091 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-25574ecd-a8d6-4524-a826-3298b1d07791 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:23.003568 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25574ecd-a8d6-4524-a826-3298b1d07791 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:23.004027 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25574ecd-a8d6-4524-a826-3298b1d07791 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:23.004816 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25574ecd-a8d6-4524-a826-3298b1d07791 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:23.005295 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25574ecd-a8d6-4524-a826-3298b1d07791 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:23.079010 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-25574ecd-a8d6-4524-a826-3298b1d07791 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:23.091530 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-25574ecd-a8d6-4524-a826-3298b1d07791 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1269 microversion: 2.1 time: 0.102038 Feb 08 17:33:23.092599 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 328/637] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:22 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:23.697671 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ae278817-eba7-4b63-8bf9-fb88a86f9ca5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:23.698802 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ae278817-eba7-4b63-8bf9-fb88a86f9ca5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:23.711512 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ae278817-eba7-4b63-8bf9-fb88a86f9ca5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:23.712316 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ae278817-eba7-4b63-8bf9-fb88a86f9ca5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:23.713829 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ae278817-eba7-4b63-8bf9-fb88a86f9ca5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:23.714621 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ae278817-eba7-4b63-8bf9-fb88a86f9ca5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:24.012101 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ae278817-eba7-4b63-8bf9-fb88a86f9ca5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:24.028748 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ae278817-eba7-4b63-8bf9-fb88a86f9ca5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1514 microversion: 2.1 time: 0.337896 Feb 08 17:33:24.029501 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 310/638] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:23 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1514 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:24.117869 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-31ae5efe-c0be-46fa-b9e5-594c32bee0e5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:24.118520 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-31ae5efe-c0be-46fa-b9e5-594c32bee0e5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:24.125678 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-31ae5efe-c0be-46fa-b9e5-594c32bee0e5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:24.126353 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-31ae5efe-c0be-46fa-b9e5-594c32bee0e5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:24.127346 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-31ae5efe-c0be-46fa-b9e5-594c32bee0e5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:24.127967 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-31ae5efe-c0be-46fa-b9e5-594c32bee0e5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:24.204212 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-31ae5efe-c0be-46fa-b9e5-594c32bee0e5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:24.212740 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-31ae5efe-c0be-46fa-b9e5-594c32bee0e5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1275 microversion: 2.1 time: 0.099174 Feb 08 17:33:24.213372 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 329/639] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:24 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1275 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:24.662480 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-7cce4185-f276-4573-b525-1067635062ce req-4e609a29-c03f-49ae-a31d-b64b5d48f540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3429541-40a1-4951-83df-6552bcb67e2e", "name": "network-vif-deleted", "tag": "07259bed-79e4-4b11-adde-1d7572de3152"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:24.664998 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:33:24.664998 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:33:24.685037 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-7cce4185-f276-4573-b525-1067635062ce req-4e609a29-c03f-49ae-a31d-b64b5d48f540 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:24.686267 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-7cce4185-f276-4573-b525-1067635062ce req-4e609a29-c03f-49ae-a31d-b64b5d48f540 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:24.702554 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-7cce4185-f276-4573-b525-1067635062ce req-4e609a29-c03f-49ae-a31d-b64b5d48f540 service nova] Creating event network-vif-deleted:07259bed-79e4-4b11-adde-1d7572de3152 for instance d3429541-40a1-4951-83df-6552bcb67e2e on hv-cinder-82204 Feb 08 17:33:24.708818 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-7cce4185-f276-4573-b525-1067635062ce req-4e609a29-c03f-49ae-a31d-b64b5d48f540 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051487 Feb 08 17:33:24.710071 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 311/640] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:33:25.054065 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c836ae18-3b10-44c3-a5c4-09b1fcabfc89 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:25.055088 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c836ae18-3b10-44c3-a5c4-09b1fcabfc89 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:25.061118 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c836ae18-3b10-44c3-a5c4-09b1fcabfc89 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:25.061835 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c836ae18-3b10-44c3-a5c4-09b1fcabfc89 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:25.062814 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c836ae18-3b10-44c3-a5c4-09b1fcabfc89 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:25.063425 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c836ae18-3b10-44c3-a5c4-09b1fcabfc89 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:25.103800 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c836ae18-3b10-44c3-a5c4-09b1fcabfc89 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:25.104245 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c836ae18-3b10-44c3-a5c4-09b1fcabfc89 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:25.104701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-c836ae18-3b10-44c3-a5c4-09b1fcabfc89 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lazy-loading 'fault' on Instance uuid d3429541-40a1-4951-83df-6552bcb67e2e {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:33:25.154639 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c836ae18-3b10-44c3-a5c4-09b1fcabfc89 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:25.166448 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c836ae18-3b10-44c3-a5c4-09b1fcabfc89 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 200 len: 1309 microversion: 2.1 time: 0.115902 Feb 08 17:33:25.167663 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 330/641] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:25 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:25.235692 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7d32b98d-f279-49ea-8fa9-c22b785926ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:25.237438 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7d32b98d-f279-49ea-8fa9-c22b785926ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:25.250476 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7d32b98d-f279-49ea-8fa9-c22b785926ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:25.251639 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7d32b98d-f279-49ea-8fa9-c22b785926ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:25.253695 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7d32b98d-f279-49ea-8fa9-c22b785926ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:25.254616 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7d32b98d-f279-49ea-8fa9-c22b785926ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:25.280575 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-70cd3cae-bb5d-4cc4-a3a9-01cc0acf5572 req-89f30e0d-5cb9-4f65-8680-016d16ec2967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29", "tag": "472f6165-5949-4189-97d6-03690f24a2a5"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:25.283159 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:33:25.283159 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:33:25.292221 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-70cd3cae-bb5d-4cc4-a3a9-01cc0acf5572 req-89f30e0d-5cb9-4f65-8680-016d16ec2967 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:25.292755 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-70cd3cae-bb5d-4cc4-a3a9-01cc0acf5572 req-89f30e0d-5cb9-4f65-8680-016d16ec2967 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:25.313625 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-70cd3cae-bb5d-4cc4-a3a9-01cc0acf5572 req-89f30e0d-5cb9-4f65-8680-016d16ec2967 service nova] Creating event network-changed:472f6165-5949-4189-97d6-03690f24a2a5 for instance 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 on hv-cinder-82204 Feb 08 17:33:25.324378 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-70cd3cae-bb5d-4cc4-a3a9-01cc0acf5572 req-89f30e0d-5cb9-4f65-8680-016d16ec2967 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055332 Feb 08 17:33:25.329664 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 331/642] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:33:25.538119 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-7d32b98d-f279-49ea-8fa9-c22b785926ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:25.545826 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7d32b98d-f279-49ea-8fa9-c22b785926ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1317 microversion: 2.1 time: 0.318532 Feb 08 17:33:25.546393 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 312/643] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:25 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:26.188200 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f350a057-151d-4da1-ae52-e0e0f005267a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:26.188903 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f350a057-151d-4da1-ae52-e0e0f005267a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: d3429541-40a1-4951-83df-6552bcb67e2e] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:26.195615 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f350a057-151d-4da1-ae52-e0e0f005267a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:26.196154 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f350a057-151d-4da1-ae52-e0e0f005267a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:26.198140 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f350a057-151d-4da1-ae52-e0e0f005267a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:26.198851 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f350a057-151d-4da1-ae52-e0e0f005267a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:26.216424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-f350a057-151d-4da1-ae52-e0e0f005267a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] HTTP exception thrown: Instance d3429541-40a1-4951-83df-6552bcb67e2e could not be found. Feb 08 17:33:26.217020 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f350a057-151d-4da1-ae52-e0e0f005267a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Returning 404 to user: Instance d3429541-40a1-4951-83df-6552bcb67e2e could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:33:26.218406 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f350a057-151d-4da1-ae52-e0e0f005267a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e" status: 404 len: 111 microversion: 2.1 time: 0.034312 Feb 08 17:33:26.218969 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 332/644] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:26 2022] GET /compute/v2.1/servers/d3429541-40a1-4951-83df-6552bcb67e2e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:33:26.569987 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-59d0e311-8d5f-4c4b-9504-ddee28441e68 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:26.571182 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-59d0e311-8d5f-4c4b-9504-ddee28441e68 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:26.579257 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59d0e311-8d5f-4c4b-9504-ddee28441e68 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:26.579829 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59d0e311-8d5f-4c4b-9504-ddee28441e68 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:26.580735 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59d0e311-8d5f-4c4b-9504-ddee28441e68 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:26.581317 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-59d0e311-8d5f-4c4b-9504-ddee28441e68 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:26.763699 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-59d0e311-8d5f-4c4b-9504-ddee28441e68 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:26.776440 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-59d0e311-8d5f-4c4b-9504-ddee28441e68 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1317 microversion: 2.1 time: 0.212009 Feb 08 17:33:26.777491 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 313/645] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:26 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:27.802665 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0d2b86fd-703d-4173-868e-e403cb1d5e81 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:27.802665 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0d2b86fd-703d-4173-868e-e403cb1d5e81 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:27.809416 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d2b86fd-703d-4173-868e-e403cb1d5e81 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:27.809994 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d2b86fd-703d-4173-868e-e403cb1d5e81 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:27.810811 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d2b86fd-703d-4173-868e-e403cb1d5e81 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:27.811097 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0d2b86fd-703d-4173-868e-e403cb1d5e81 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:27.986583 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0d2b86fd-703d-4173-868e-e403cb1d5e81 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:27.995316 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0d2b86fd-703d-4173-868e-e403cb1d5e81 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1317 microversion: 2.1 time: 0.196939 Feb 08 17:33:27.995907 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 333/646] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:27 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:29.012528 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8e61f026-73c5-426e-a806-363bee21cd46 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:29.013208 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8e61f026-73c5-426e-a806-363bee21cd46 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:29.020291 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8e61f026-73c5-426e-a806-363bee21cd46 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:29.020843 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8e61f026-73c5-426e-a806-363bee21cd46 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:29.021749 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8e61f026-73c5-426e-a806-363bee21cd46 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:29.022224 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8e61f026-73c5-426e-a806-363bee21cd46 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:29.178290 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8e61f026-73c5-426e-a806-363bee21cd46 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:29.186086 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8e61f026-73c5-426e-a806-363bee21cd46 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1317 microversion: 2.1 time: 0.177144 Feb 08 17:33:29.186683 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 314/647] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:29 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:30.204889 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0ef11f15-0afa-4730-8b37-07a17faf21c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:30.206283 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0ef11f15-0afa-4730-8b37-07a17faf21c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:30.216397 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0ef11f15-0afa-4730-8b37-07a17faf21c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:30.217623 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0ef11f15-0afa-4730-8b37-07a17faf21c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:30.218808 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0ef11f15-0afa-4730-8b37-07a17faf21c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:30.219077 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0ef11f15-0afa-4730-8b37-07a17faf21c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:30.424781 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0ef11f15-0afa-4730-8b37-07a17faf21c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:30.432804 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0ef11f15-0afa-4730-8b37-07a17faf21c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1317 microversion: 2.1 time: 0.234070 Feb 08 17:33:30.433445 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 334/648] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:30 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:31.451892 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-546b355c-360d-4a13-aa9a-22c944731cbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:31.452958 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-546b355c-360d-4a13-aa9a-22c944731cbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:31.466467 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-546b355c-360d-4a13-aa9a-22c944731cbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:31.467431 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-546b355c-360d-4a13-aa9a-22c944731cbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:31.468235 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-546b355c-360d-4a13-aa9a-22c944731cbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:31.468704 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-546b355c-360d-4a13-aa9a-22c944731cbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:31.631584 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-546b355c-360d-4a13-aa9a-22c944731cbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:31.633847 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-35ae27a8-c667-4831-bf0a-bb347b40c903 req-76a9024e-1bd8-4d97-9e8f-1ab4bd5459da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29", "name": "network-vif-plugged", "status": "completed", "tag": "472f6165-5949-4189-97d6-03690f24a2a5"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:31.638544 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:33:31.638544 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:33:31.646096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-546b355c-360d-4a13-aa9a-22c944731cbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1317 microversion: 2.1 time: 0.198506 Feb 08 17:33:31.647427 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 315/649] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:31 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:31.647627 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-35ae27a8-c667-4831-bf0a-bb347b40c903 req-76a9024e-1bd8-4d97-9e8f-1ab4bd5459da service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:31.648299 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-35ae27a8-c667-4831-bf0a-bb347b40c903 req-76a9024e-1bd8-4d97-9e8f-1ab4bd5459da service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:31.664245 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-35ae27a8-c667-4831-bf0a-bb347b40c903 req-76a9024e-1bd8-4d97-9e8f-1ab4bd5459da service nova] Creating event network-vif-plugged:472f6165-5949-4189-97d6-03690f24a2a5 for instance 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 on hv-cinder-82204 Feb 08 17:33:31.669570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-35ae27a8-c667-4831-bf0a-bb347b40c903 req-76a9024e-1bd8-4d97-9e8f-1ab4bd5459da service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043903 Feb 08 17:33:31.670932 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 335/650] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:33:32.669473 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a3a1c0ef-1dc1-43ad-add7-74d5bfb25332 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:32.670710 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a3a1c0ef-1dc1-43ad-add7-74d5bfb25332 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:32.677238 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a3a1c0ef-1dc1-43ad-add7-74d5bfb25332 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:32.677691 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a3a1c0ef-1dc1-43ad-add7-74d5bfb25332 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:32.678496 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a3a1c0ef-1dc1-43ad-add7-74d5bfb25332 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:32.678948 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a3a1c0ef-1dc1-43ad-add7-74d5bfb25332 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:32.843973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a3a1c0ef-1dc1-43ad-add7-74d5bfb25332 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:32.851857 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a3a1c0ef-1dc1-43ad-add7-74d5bfb25332 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1317 microversion: 2.1 time: 0.186168 Feb 08 17:33:32.852457 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 316/651] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:32 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:32.974512 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3f150a41-7f68-4c01-8c83-42814bd8edc3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:32.975561 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3f150a41-7f68-4c01-8c83-42814bd8edc3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:32.981974 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3f150a41-7f68-4c01-8c83-42814bd8edc3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:32.983022 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3f150a41-7f68-4c01-8c83-42814bd8edc3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:32.983841 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3f150a41-7f68-4c01-8c83-42814bd8edc3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:32.984269 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3f150a41-7f68-4c01-8c83-42814bd8edc3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:33.073600 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3f150a41-7f68-4c01-8c83-42814bd8edc3 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "POST /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/action" status: 202 len: 0 microversion: 2.1 time: 0.104256 Feb 08 17:33:33.074609 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 336/652] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:33:32 2022] POST /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:33:33.085810 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d8c9fad5-cb96-42ca-8a58-ae4a0aa03c27 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:33.086817 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d8c9fad5-cb96-42ca-8a58-ae4a0aa03c27 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:33.100109 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d8c9fad5-cb96-42ca-8a58-ae4a0aa03c27 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:33.100562 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d8c9fad5-cb96-42ca-8a58-ae4a0aa03c27 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:33.101517 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d8c9fad5-cb96-42ca-8a58-ae4a0aa03c27 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:33.102047 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d8c9fad5-cb96-42ca-8a58-ae4a0aa03c27 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:33.520406 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d8c9fad5-cb96-42ca-8a58-ae4a0aa03c27 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:33.528515 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d8c9fad5-cb96-42ca-8a58-ae4a0aa03c27 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1750 microversion: 2.1 time: 0.447599 Feb 08 17:33:33.529100 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 317/653] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:33 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1750 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:33.869611 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c801afce-6ea8-43b1-8989-5093efdf56e1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:33.870285 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c801afce-6ea8-43b1-8989-5093efdf56e1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:33.877251 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c801afce-6ea8-43b1-8989-5093efdf56e1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:33.877705 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c801afce-6ea8-43b1-8989-5093efdf56e1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:33.878500 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c801afce-6ea8-43b1-8989-5093efdf56e1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:33.878938 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c801afce-6ea8-43b1-8989-5093efdf56e1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:34.023328 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c801afce-6ea8-43b1-8989-5093efdf56e1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:34.031040 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c801afce-6ea8-43b1-8989-5093efdf56e1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1317 microversion: 2.1 time: 0.165487 Feb 08 17:33:34.031626 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 337/654] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:33 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:34.223187 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a69bee9c-e8e7-4eb7-ba59-63c60768096c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:34.223724 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a69bee9c-e8e7-4eb7-ba59-63c60768096c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:34.229697 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a69bee9c-e8e7-4eb7-ba59-63c60768096c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:34.230142 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a69bee9c-e8e7-4eb7-ba59-63c60768096c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:34.230936 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a69bee9c-e8e7-4eb7-ba59-63c60768096c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:34.231366 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a69bee9c-e8e7-4eb7-ba59-63c60768096c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:34.262461 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a69bee9c-e8e7-4eb7-ba59-63c60768096c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments/f81e6ac8-b541-49e2-af34-6d7ac8651479" status: 200 len: 194 microversion: 2.20 time: 0.154837 Feb 08 17:33:34.263059 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 318/655] 10.222.0.69 () {60 vars in 1453 bytes} [Tue Feb 8 17:33:34 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments/f81e6ac8-b541-49e2-af34-6d7ac8651479 => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 17:33:34.325120 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-900b8588-a1da-4235-8932-07df25a63173 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:34.325628 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-900b8588-a1da-4235-8932-07df25a63173 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:34.332186 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-900b8588-a1da-4235-8932-07df25a63173 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:34.332632 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-900b8588-a1da-4235-8932-07df25a63173 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:34.333448 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-900b8588-a1da-4235-8932-07df25a63173 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:34.333881 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-900b8588-a1da-4235-8932-07df25a63173 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:34.415143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-900b8588-a1da-4235-8932-07df25a63173 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lazy-loading 'services' on Instance uuid c73f173b-bae7-44a2-b686-0179e64e9c30 {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:33:34.485917 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-900b8588-a1da-4235-8932-07df25a63173 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments/f81e6ac8-b541-49e2-af34-6d7ac8651479" status: 202 len: 0 microversion: 2.20 time: 0.164352 Feb 08 17:33:34.486537 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 338/656] 10.222.0.69 () {60 vars in 1456 bytes} [Tue Feb 8 17:33:34 2022] DELETE /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments/f81e6ac8-b541-49e2-af34-6d7ac8651479 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:33:34.495674 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-be5ad32d-7997-4c42-ab8f-96ef44c5516b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:34.496669 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-be5ad32d-7997-4c42-ab8f-96ef44c5516b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:34.503442 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be5ad32d-7997-4c42-ab8f-96ef44c5516b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:34.503892 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be5ad32d-7997-4c42-ab8f-96ef44c5516b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:34.504687 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be5ad32d-7997-4c42-ab8f-96ef44c5516b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:34.505122 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-be5ad32d-7997-4c42-ab8f-96ef44c5516b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:34.535420 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-be5ad32d-7997-4c42-ab8f-96ef44c5516b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043534 Feb 08 17:33:34.535996 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 319/657] 10.222.0.69 () {60 vars in 1342 bytes} [Tue Feb 8 17:33:34 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 17:33:34.547579 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-cd976cde-38cf-4056-8921-39e4b9ae390b tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:34.548269 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-cd976cde-38cf-4056-8921-39e4b9ae390b tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:34.554423 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cd976cde-38cf-4056-8921-39e4b9ae390b tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:34.554867 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cd976cde-38cf-4056-8921-39e4b9ae390b tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:34.555642 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cd976cde-38cf-4056-8921-39e4b9ae390b tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:34.556068 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cd976cde-38cf-4056-8921-39e4b9ae390b tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:34.710884 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-cd976cde-38cf-4056-8921-39e4b9ae390b tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:34.719288 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-cd976cde-38cf-4056-8921-39e4b9ae390b tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1750 microversion: 2.1 time: 0.175661 Feb 08 17:33:34.719881 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 339/658] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:34 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:35.049676 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5fb6a62f-4da4-464a-99f2-5c528cbcde78 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:35.050839 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5fb6a62f-4da4-464a-99f2-5c528cbcde78 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:35.061054 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5fb6a62f-4da4-464a-99f2-5c528cbcde78 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:35.061769 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5fb6a62f-4da4-464a-99f2-5c528cbcde78 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:35.063057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5fb6a62f-4da4-464a-99f2-5c528cbcde78 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:35.063578 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5fb6a62f-4da4-464a-99f2-5c528cbcde78 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:35.287251 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1722281683", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "networks": [{"uuid": "e00650e9-60fb-433d-8933-974a605223d2"}]}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:35.362423 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5fb6a62f-4da4-464a-99f2-5c528cbcde78 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:35.373533 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5fb6a62f-4da4-464a-99f2-5c528cbcde78 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1317 microversion: 2.1 time: 0.329870 Feb 08 17:33:35.374284 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.network.neutron [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] validate_networks() for [('e00650e9-60fb-433d-8933-974a605223d2', None, None, None, None, None)] {{(pid=116480) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:33:35.382499 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 320/659] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:35 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:35.550723 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-23a012a6-028c-4d2b-8a40-d5fc4845174e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:35.552634 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-23a012a6-028c-4d2b-8a40-d5fc4845174e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:35.570765 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-23a012a6-028c-4d2b-8a40-d5fc4845174e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:35.571567 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-23a012a6-028c-4d2b-8a40-d5fc4845174e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:35.573015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-23a012a6-028c-4d2b-8a40-d5fc4845174e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:35.574013 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-23a012a6-028c-4d2b-8a40-d5fc4845174e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:35.621553 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-23a012a6-028c-4d2b-8a40-d5fc4845174e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076239 Feb 08 17:33:35.625775 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 321/660] 10.222.0.69 () {60 vars in 1342 bytes} [Tue Feb 8 17:33:35 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 17:33:35.738484 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d11da050-1e84-42d8-937a-7c5d07db2936 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:35.740224 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d11da050-1e84-42d8-937a-7c5d07db2936 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:35.749088 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d11da050-1e84-42d8-937a-7c5d07db2936 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:35.749646 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d11da050-1e84-42d8-937a-7c5d07db2936 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:35.750389 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d11da050-1e84-42d8-937a-7c5d07db2936 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:35.750943 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d11da050-1e84-42d8-937a-7c5d07db2936 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:35.960214 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Flavor limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:33:35.961030 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Image limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:33:35.962013 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Flavor pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:33:35.962496 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Image pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:33:35.963582 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:33:35.979467 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:35.980750 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:35.982649 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:35.983776 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.013531 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Getting quotas for project 8bc58680f1494f0c941c254f20b7ad9f. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:33:36.021032 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Getting quotas for user b4f7c4ae54ed48e8964818e2cc18bc53 and project 8bc58680f1494f0c941c254f20b7ad9f. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:33:36.025793 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d11da050-1e84-42d8-937a-7c5d07db2936 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:36.035297 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d11da050-1e84-42d8-937a-7c5d07db2936 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1750 microversion: 2.1 time: 0.301949 Feb 08 17:33:36.036228 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 322/661] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:35 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1750 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:36.044140 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Going to run 1 instances... {{(pid=116480) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:33:36.049475 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116480) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:33:36.127150 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d2e490b4-6c0a-405b-8dd7-4a2daf95fdc4 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848664 Feb 08 17:33:36.128884 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 340/662] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:33:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:33:36.147623 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5cc01498-ecb6-40c3-b96d-7c03b27b36ce tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:36.149365 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5cc01498-ecb6-40c3-b96d-7c03b27b36ce tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:36.233975 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5cc01498-ecb6-40c3-b96d-7c03b27b36ce tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:36.247543 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5cc01498-ecb6-40c3-b96d-7c03b27b36ce tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1219 microversion: 2.1 time: 0.111996 Feb 08 17:33:36.258935 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 323/663] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:36 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:36.398800 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9ff60ba3-1ce1-4421-b604-9abed15997c7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:36.400079 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9ff60ba3-1ce1-4421-b604-9abed15997c7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:36.409796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ff60ba3-1ce1-4421-b604-9abed15997c7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.410328 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ff60ba3-1ce1-4421-b604-9abed15997c7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.411219 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ff60ba3-1ce1-4421-b604-9abed15997c7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.411618 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ff60ba3-1ce1-4421-b604-9abed15997c7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.621821 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9ff60ba3-1ce1-4421-b604-9abed15997c7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:36.633333 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9ff60ba3-1ce1-4421-b604-9abed15997c7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1505 microversion: 2.1 time: 0.242383 Feb 08 17:33:36.634244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 341/664] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:36 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:36.636359 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-07e34368-71a4-4f87-9ac8-bf8ed555fdd0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:36.638080 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-07e34368-71a4-4f87-9ac8-bf8ed555fdd0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:36.651160 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-07e34368-71a4-4f87-9ac8-bf8ed555fdd0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.651891 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-07e34368-71a4-4f87-9ac8-bf8ed555fdd0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.652063 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fffd6401-de45-47f9-bc30-15afbb054b45 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6af56e2b-d473-492b-98f5-6e2f51b0b40f"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:36.653084 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-fffd6401-de45-47f9-bc30-15afbb054b45 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:36.653254 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-07e34368-71a4-4f87-9ac8-bf8ed555fdd0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.653683 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-07e34368-71a4-4f87-9ac8-bf8ed555fdd0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.662503 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fffd6401-de45-47f9-bc30-15afbb054b45 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.663230 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fffd6401-de45-47f9-bc30-15afbb054b45 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.664264 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fffd6401-de45-47f9-bc30-15afbb054b45 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.664752 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fffd6401-de45-47f9-bc30-15afbb054b45 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.694200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-07e34368-71a4-4f87-9ac8-bf8ed555fdd0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064059 Feb 08 17:33:36.695126 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 324/665] 10.222.0.69 () {60 vars in 1342 bytes} [Tue Feb 8 17:33:36 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:36.767873 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-01ae79bb-7cca-4ecc-a127-731ee149888b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:36.768837 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-01ae79bb-7cca-4ecc-a127-731ee149888b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:36.781570 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-01ae79bb-7cca-4ecc-a127-731ee149888b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.782356 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-01ae79bb-7cca-4ecc-a127-731ee149888b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.783738 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-01ae79bb-7cca-4ecc-a127-731ee149888b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.784663 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-01ae79bb-7cca-4ecc-a127-731ee149888b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.807617 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-fffd6401-de45-47f9-bc30-15afbb054b45 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] HTTP exception thrown: Invalid volume: volume 6af56e2b-d473-492b-98f5-6e2f51b0b40f is already attached to instances: 9e1c405c-8f1a-49d0-a128-67027dae51ed Feb 08 17:33:36.808235 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fffd6401-de45-47f9-bc30-15afbb054b45 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Returning 400 to user: Invalid volume: volume 6af56e2b-d473-492b-98f5-6e2f51b0b40f is already attached to instances: 9e1c405c-8f1a-49d0-a128-67027dae51ed {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:33:36.809077 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-fffd6401-de45-47f9-bc30-15afbb054b45 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "POST /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.161747 Feb 08 17:33:36.810005 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 342/666] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:33:36 2022] POST /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29/os-volume_attachments => generated 174 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 08 17:33:36.820408 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-01ae79bb-7cca-4ecc-a127-731ee149888b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Going to try to terminate instance {{(pid=116479) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:33:36.893802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-498a1be9-cca0-4f6b-837c-5bc37be17115 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:36.894689 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-498a1be9-cca0-4f6b-837c-5bc37be17115 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:36.910041 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-498a1be9-cca0-4f6b-837c-5bc37be17115 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.910770 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-498a1be9-cca0-4f6b-837c-5bc37be17115 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.912141 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-498a1be9-cca0-4f6b-837c-5bc37be17115 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.913206 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-498a1be9-cca0-4f6b-837c-5bc37be17115 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.959491 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-01ae79bb-7cca-4ecc-a127-731ee149888b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 204 len: 0 microversion: 2.20 time: 0.197495 Feb 08 17:33:36.961127 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 325/667] 10.222.0.69 () {60 vars in 1279 bytes} [Tue Feb 8 17:33:36 2022] DELETE /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 08 17:33:36.971838 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ca8d537e-5621-4a8d-a4be-24628e70ffab tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:36.973148 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ca8d537e-5621-4a8d-a4be-24628e70ffab tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:36.979558 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ca8d537e-5621-4a8d-a4be-24628e70ffab tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.980000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ca8d537e-5621-4a8d-a4be-24628e70ffab tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:36.981415 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ca8d537e-5621-4a8d-a4be-24628e70ffab tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:36.982220 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ca8d537e-5621-4a8d-a4be-24628e70ffab tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:37.040163 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-498a1be9-cca0-4f6b-837c-5bc37be17115 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lazy-loading 'services' on Instance uuid 9e1c405c-8f1a-49d0-a128-67027dae51ed {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:33:37.175159 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-498a1be9-cca0-4f6b-837c-5bc37be17115 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed/os-volume_attachments/6af56e2b-d473-492b-98f5-6e2f51b0b40f" status: 202 len: 0 microversion: 2.1 time: 0.288178 Feb 08 17:33:37.176890 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 343/668] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:33:36 2022] DELETE /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed/os-volume_attachments/6af56e2b-d473-492b-98f5-6e2f51b0b40f => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 17:33:37.183799 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e140eca6-668a-4d77-84be-b7beeb53d0a0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:37.184535 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e140eca6-668a-4d77-84be-b7beeb53d0a0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:37.192250 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e140eca6-668a-4d77-84be-b7beeb53d0a0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:37.193035 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e140eca6-668a-4d77-84be-b7beeb53d0a0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:37.194108 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e140eca6-668a-4d77-84be-b7beeb53d0a0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:37.194543 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e140eca6-668a-4d77-84be-b7beeb53d0a0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:37.203886 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ca8d537e-5621-4a8d-a4be-24628e70ffab tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:37.221898 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ca8d537e-5621-4a8d-a4be-24628e70ffab tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:37.223972 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ca8d537e-5621-4a8d-a4be-24628e70ffab tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:37.225509 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ca8d537e-5621-4a8d-a4be-24628e70ffab tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.257765 Feb 08 17:33:37.226187 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 326/669] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:36 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:33:37.235824 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-caa2b577-1a0a-4b2b-9141-147330a1052b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:37.237495 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-caa2b577-1a0a-4b2b-9141-147330a1052b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:37.255339 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-caa2b577-1a0a-4b2b-9141-147330a1052b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:37.256166 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-caa2b577-1a0a-4b2b-9141-147330a1052b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:37.257675 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-caa2b577-1a0a-4b2b-9141-147330a1052b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:37.258502 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-caa2b577-1a0a-4b2b-9141-147330a1052b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:37.304372 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-caa2b577-1a0a-4b2b-9141-147330a1052b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076498 Feb 08 17:33:37.305308 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 327/670] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:33:37 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:33:37.309583 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e47d82f5-089c-4a03-b851-8b6c010390ac tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:37.310418 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-e47d82f5-089c-4a03-b851-8b6c010390ac tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:37.323124 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e47d82f5-089c-4a03-b851-8b6c010390ac tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:37.323589 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e47d82f5-089c-4a03-b851-8b6c010390ac tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:37.324407 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e47d82f5-089c-4a03-b851-8b6c010390ac tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:37.324846 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e47d82f5-089c-4a03-b851-8b6c010390ac tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:37.418909 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e47d82f5-089c-4a03-b851-8b6c010390ac tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:37.419933 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e140eca6-668a-4d77-84be-b7beeb53d0a0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:37.428778 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e47d82f5-089c-4a03-b851-8b6c010390ac tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1271 microversion: 2.1 time: 0.122535 Feb 08 17:33:37.432164 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 328/671] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:37 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:37.436068 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e140eca6-668a-4d77-84be-b7beeb53d0a0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.256303 Feb 08 17:33:37.437099 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 344/672] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:37 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:38.258353 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3399e827-f2a1-4d73-954e-d1610018d97b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:38.259445 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3399e827-f2a1-4d73-954e-d1610018d97b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:38.269818 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3399e827-f2a1-4d73-954e-d1610018d97b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:38.270753 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3399e827-f2a1-4d73-954e-d1610018d97b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:38.272174 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3399e827-f2a1-4d73-954e-d1610018d97b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:38.273100 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3399e827-f2a1-4d73-954e-d1610018d97b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:38.320013 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a77600dc-571c-4427-bc1b-a1dd7c142ee9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:38.321422 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a77600dc-571c-4427-bc1b-a1dd7c142ee9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:38.338096 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a77600dc-571c-4427-bc1b-a1dd7c142ee9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:38.338599 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a77600dc-571c-4427-bc1b-a1dd7c142ee9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:38.339695 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a77600dc-571c-4427-bc1b-a1dd7c142ee9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:38.340168 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a77600dc-571c-4427-bc1b-a1dd7c142ee9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:38.382500 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a77600dc-571c-4427-bc1b-a1dd7c142ee9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068434 Feb 08 17:33:38.383149 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 345/673] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:33:38 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 08 17:33:38.449948 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-485cbc6b-3bce-4045-b811-413a16182a37 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:38.451936 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-485cbc6b-3bce-4045-b811-413a16182a37 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:38.460421 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-485cbc6b-3bce-4045-b811-413a16182a37 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:38.461326 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-485cbc6b-3bce-4045-b811-413a16182a37 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:38.462142 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-485cbc6b-3bce-4045-b811-413a16182a37 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:38.462563 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-485cbc6b-3bce-4045-b811-413a16182a37 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:38.615002 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3399e827-f2a1-4d73-954e-d1610018d97b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:38.627385 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3399e827-f2a1-4d73-954e-d1610018d97b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:38.629296 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3399e827-f2a1-4d73-954e-d1610018d97b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:38.630939 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3399e827-f2a1-4d73-954e-d1610018d97b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.379650 Feb 08 17:33:38.632082 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 329/674] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:38 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:33:38.637279 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-43d53f40-94f3-4253-af9c-e6a1daeed6d2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:38.638328 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-43d53f40-94f3-4253-af9c-e6a1daeed6d2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:38.653430 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-43d53f40-94f3-4253-af9c-e6a1daeed6d2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:38.654290 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-43d53f40-94f3-4253-af9c-e6a1daeed6d2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:38.656425 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-43d53f40-94f3-4253-af9c-e6a1daeed6d2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:38.657394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-43d53f40-94f3-4253-af9c-e6a1daeed6d2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:38.706687 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-485cbc6b-3bce-4045-b811-413a16182a37 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:38.718898 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-485cbc6b-3bce-4045-b811-413a16182a37 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1319 microversion: 2.1 time: 0.274066 Feb 08 17:33:38.719484 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 346/675] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:38 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:38.724787 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1811611643", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "networks": [{"uuid": "68303811-987d-45d3-911c-ea578153745e"}]}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:38.795891 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.network.neutron [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] validate_networks() for [('68303811-987d-45d3-911c-ea578153745e', None, None, None, None, None)] {{(pid=116480) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:33:39.020680 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-43d53f40-94f3-4253-af9c-e6a1daeed6d2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:39.039951 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-43d53f40-94f3-4253-af9c-e6a1daeed6d2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.405690 Feb 08 17:33:39.055002 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 330/676] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:38 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:39.284178 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Flavor limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:33:39.285022 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Image limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:33:39.286018 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Flavor pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:33:39.286746 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Image pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:33:39.287492 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:33:39.306152 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:39.306948 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:39.308423 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:39.309370 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:39.346502 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Getting quotas for project 74eb713ad3e34829a512ab7b068613e4. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:33:39.354503 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Getting quotas for user 4ecb87afe54d4389b8177a3570088e67 and project 74eb713ad3e34829a512ab7b068613e4. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:33:39.376383 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Going to run 1 instances... {{(pid=116480) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:33:39.380853 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116480) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:33:39.442084 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6f18756a-719e-49af-8ece-f9286c52a2a1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721467 Feb 08 17:33:39.443091 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 347/677] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:33:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:33:39.453213 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8655f7b5-6f0f-4a65-a4b1-50d1c81dbfbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:39.454476 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8655f7b5-6f0f-4a65-a4b1-50d1c81dbfbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:39.581985 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8655f7b5-6f0f-4a65-a4b1-50d1c81dbfbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:39.589096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8655f7b5-6f0f-4a65-a4b1-50d1c81dbfbc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1218 microversion: 2.1 time: 0.140040 Feb 08 17:33:39.589918 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 331/678] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:39 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:39.659243 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8d26fbbe-f503-4d0f-ac85-e9503ceb39b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:39.662009 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8d26fbbe-f503-4d0f-ac85-e9503ceb39b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:39.676922 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8d26fbbe-f503-4d0f-ac85-e9503ceb39b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:39.678087 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8d26fbbe-f503-4d0f-ac85-e9503ceb39b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:39.681701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8d26fbbe-f503-4d0f-ac85-e9503ceb39b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:39.684210 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8d26fbbe-f503-4d0f-ac85-e9503ceb39b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:39.783854 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-a8809f17-25dd-4132-bbda-843152a13550 req-f3331fef-d6f3-4454-a8f8-bc7d41c7cc65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "538dbde7-2cb0-44ca-9f40-203e7a7764a3", "tag": "2ce2fd96-10b4-41ed-951a-837a866ac88e"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:39.785621 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:33:39.785621 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:33:39.805299 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-a8809f17-25dd-4132-bbda-843152a13550 req-f3331fef-d6f3-4454-a8f8-bc7d41c7cc65 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:39.806151 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-a8809f17-25dd-4132-bbda-843152a13550 req-f3331fef-d6f3-4454-a8f8-bc7d41c7cc65 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:39.832600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-a8809f17-25dd-4132-bbda-843152a13550 req-f3331fef-d6f3-4454-a8f8-bc7d41c7cc65 service nova] Creating event network-changed:2ce2fd96-10b4-41ed-951a-837a866ac88e for instance 538dbde7-2cb0-44ca-9f40-203e7a7764a3 on hv-cinder-82204 Feb 08 17:33:39.841022 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-a8809f17-25dd-4132-bbda-843152a13550 req-f3331fef-d6f3-4454-a8f8-bc7d41c7cc65 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152421 Feb 08 17:33:39.842923 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 332/679] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:33:39.854082 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-9caad85d-ef2b-4ac4-b23b-b22fdb810935 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:39.855742 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-9caad85d-ef2b-4ac4-b23b-b22fdb810935 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:39.866356 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9caad85d-ef2b-4ac4-b23b-b22fdb810935 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:39.867130 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9caad85d-ef2b-4ac4-b23b-b22fdb810935 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:39.868184 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9caad85d-ef2b-4ac4-b23b-b22fdb810935 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:39.869553 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9caad85d-ef2b-4ac4-b23b-b22fdb810935 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:39.993060 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8d26fbbe-f503-4d0f-ac85-e9503ceb39b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:40.010857 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8d26fbbe-f503-4d0f-ac85-e9503ceb39b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:40.014661 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8d26fbbe-f503-4d0f-ac85-e9503ceb39b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:40.017613 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8d26fbbe-f503-4d0f-ac85-e9503ceb39b7 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1725 microversion: 2.20 time: 0.362121 Feb 08 17:33:40.018989 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 348/680] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:39 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1725 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:33:40.071540 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8fcaf87f-e1ab-4abf-a907-ea0278809c72 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:40.073045 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8fcaf87f-e1ab-4abf-a907-ea0278809c72 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:40.087381 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8fcaf87f-e1ab-4abf-a907-ea0278809c72 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:40.088385 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8fcaf87f-e1ab-4abf-a907-ea0278809c72 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:40.105760 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8fcaf87f-e1ab-4abf-a907-ea0278809c72 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:40.106998 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8fcaf87f-e1ab-4abf-a907-ea0278809c72 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:40.293391 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-9caad85d-ef2b-4ac4-b23b-b22fdb810935 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:40.314940 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-9caad85d-ef2b-4ac4-b23b-b22fdb810935 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1319 microversion: 2.1 time: 0.467615 Feb 08 17:33:40.331470 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 333/681] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:39 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:40.486757 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8fcaf87f-e1ab-4abf-a907-ea0278809c72 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:40.496475 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8fcaf87f-e1ab-4abf-a907-ea0278809c72 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.429896 Feb 08 17:33:40.507427 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 349/682] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:40 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:40.610818 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8875654d-00e2-4032-9dbe-b617b1d3d989 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:40.612670 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8875654d-00e2-4032-9dbe-b617b1d3d989 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:40.620180 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8875654d-00e2-4032-9dbe-b617b1d3d989 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:40.620648 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8875654d-00e2-4032-9dbe-b617b1d3d989 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:40.621500 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8875654d-00e2-4032-9dbe-b617b1d3d989 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:40.621940 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8875654d-00e2-4032-9dbe-b617b1d3d989 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:40.746394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8875654d-00e2-4032-9dbe-b617b1d3d989 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:40.772141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8875654d-00e2-4032-9dbe-b617b1d3d989 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1270 microversion: 2.1 time: 0.168288 Feb 08 17:33:40.773225 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 334/683] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:40 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:41.051726 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6b5dda00-0734-4f5d-9abd-c2b9b989d23e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:41.053598 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6b5dda00-0734-4f5d-9abd-c2b9b989d23e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:41.065778 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b5dda00-0734-4f5d-9abd-c2b9b989d23e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:41.066713 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b5dda00-0734-4f5d-9abd-c2b9b989d23e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:41.068551 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b5dda00-0734-4f5d-9abd-c2b9b989d23e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:41.069773 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b5dda00-0734-4f5d-9abd-c2b9b989d23e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:41.273874 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6b5dda00-0734-4f5d-9abd-c2b9b989d23e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:41.288967 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6b5dda00-0734-4f5d-9abd-c2b9b989d23e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:41.292376 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6b5dda00-0734-4f5d-9abd-c2b9b989d23e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:41.295210 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6b5dda00-0734-4f5d-9abd-c2b9b989d23e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1658 microversion: 2.20 time: 0.249253 Feb 08 17:33:41.296215 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 350/684] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:41 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1658 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:33:41.350458 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-42b4a0b0-53cc-4c03-934a-fa3abfecc2d1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:41.352068 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-42b4a0b0-53cc-4c03-934a-fa3abfecc2d1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:41.364683 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42b4a0b0-53cc-4c03-934a-fa3abfecc2d1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:41.366852 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42b4a0b0-53cc-4c03-934a-fa3abfecc2d1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:41.369313 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42b4a0b0-53cc-4c03-934a-fa3abfecc2d1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:41.370365 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42b4a0b0-53cc-4c03-934a-fa3abfecc2d1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:41.517538 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bf64a0a9-628b-4295-ba2d-13c71c4645f0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:41.518798 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bf64a0a9-628b-4295-ba2d-13c71c4645f0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:41.526479 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf64a0a9-628b-4295-ba2d-13c71c4645f0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:41.526963 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf64a0a9-628b-4295-ba2d-13c71c4645f0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:41.527705 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf64a0a9-628b-4295-ba2d-13c71c4645f0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:41.528311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf64a0a9-628b-4295-ba2d-13c71c4645f0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:41.847579 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bf64a0a9-628b-4295-ba2d-13c71c4645f0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:41.857651 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bf64a0a9-628b-4295-ba2d-13c71c4645f0 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.345665 Feb 08 17:33:41.858403 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 351/685] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:41 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:41.863858 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-04346b26-8054-4d06-82d2-adac9e2d6fc0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:41.864765 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-04346b26-8054-4d06-82d2-adac9e2d6fc0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:41.872036 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-04346b26-8054-4d06-82d2-adac9e2d6fc0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:41.873527 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-04346b26-8054-4d06-82d2-adac9e2d6fc0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:41.874533 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-04346b26-8054-4d06-82d2-adac9e2d6fc0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:41.875133 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-04346b26-8054-4d06-82d2-adac9e2d6fc0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:41.963394 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-04346b26-8054-4d06-82d2-adac9e2d6fc0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:41.973104 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-04346b26-8054-4d06-82d2-adac9e2d6fc0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1276 microversion: 2.1 time: 0.113261 Feb 08 17:33:41.974220 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 352/686] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:41 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:42.124739 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-37c5fa5c-89cc-49ff-926a-1f0a7f573681 req-72f1d83d-3dcf-4141-b6fb-5c94722b85ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73f173b-bae7-44a2-b686-0179e64e9c30", "name": "network-vif-deleted", "tag": "72759e6a-9d50-4192-90ea-3e1d17bb4b78"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:42.132406 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:33:42.132406 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:33:42.150552 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-37c5fa5c-89cc-49ff-926a-1f0a7f573681 req-72f1d83d-3dcf-4141-b6fb-5c94722b85ce service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:42.152587 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-37c5fa5c-89cc-49ff-926a-1f0a7f573681 req-72f1d83d-3dcf-4141-b6fb-5c94722b85ce service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:42.161073 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-42b4a0b0-53cc-4c03-934a-fa3abfecc2d1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:42.173902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-42b4a0b0-53cc-4c03-934a-fa3abfecc2d1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1319 microversion: 2.1 time: 0.830059 Feb 08 17:33:42.175166 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 335/687] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:41 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1319 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:42.198719 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-37c5fa5c-89cc-49ff-926a-1f0a7f573681 req-72f1d83d-3dcf-4141-b6fb-5c94722b85ce service nova] Creating event network-vif-deleted:72759e6a-9d50-4192-90ea-3e1d17bb4b78 for instance c73f173b-bae7-44a2-b686-0179e64e9c30 on hv-cinder-82204 Feb 08 17:33:42.209048 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-37c5fa5c-89cc-49ff-926a-1f0a7f573681 req-72f1d83d-3dcf-4141-b6fb-5c94722b85ce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094929 Feb 08 17:33:42.210376 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 353/688] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:33:42.329122 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:42.329949 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:42.344715 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:42.345761 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:42.347524 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:42.348664 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:42.416193 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:42.416949 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:42.418111 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lazy-loading 'fault' on Instance uuid c73f173b-bae7-44a2-b686-0179e64e9c30 {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:33:42.499491 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:42.511650 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:42.513863 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:42.515320 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cb63699a-59b3-48d8-8e67-a817942266dc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 200 len: 1372 microversion: 2.20 time: 0.194729 Feb 08 17:33:42.516632 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 336/689] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:42 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:33:42.879795 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-01923b0f-e2f4-4a47-a27f-d4e49ad3959f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:42.880500 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-01923b0f-e2f4-4a47-a27f-d4e49ad3959f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:42.894990 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-01923b0f-e2f4-4a47-a27f-d4e49ad3959f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:42.895768 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-01923b0f-e2f4-4a47-a27f-d4e49ad3959f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:42.896766 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-01923b0f-e2f4-4a47-a27f-d4e49ad3959f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:42.897409 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-01923b0f-e2f4-4a47-a27f-d4e49ad3959f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:42.992957 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2c6383c7-61e4-4920-9780-f5408571d291 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:42.993707 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2c6383c7-61e4-4920-9780-f5408571d291 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:43.015168 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2c6383c7-61e4-4920-9780-f5408571d291 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:43.016004 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2c6383c7-61e4-4920-9780-f5408571d291 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:43.017146 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2c6383c7-61e4-4920-9780-f5408571d291 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:43.017714 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2c6383c7-61e4-4920-9780-f5408571d291 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:43.169952 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-01923b0f-e2f4-4a47-a27f-d4e49ad3959f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:43.183338 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-01923b0f-e2f4-4a47-a27f-d4e49ad3959f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.309978 Feb 08 17:33:43.184388 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 354/690] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:42 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:43.198472 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2f6fde5c-13fa-44dd-b5b1-c252ed27cf81 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:43.201563 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2f6fde5c-13fa-44dd-b5b1-c252ed27cf81 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:43.211100 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f6fde5c-13fa-44dd-b5b1-c252ed27cf81 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:43.212210 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f6fde5c-13fa-44dd-b5b1-c252ed27cf81 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:43.213788 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f6fde5c-13fa-44dd-b5b1-c252ed27cf81 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:43.214740 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f6fde5c-13fa-44dd-b5b1-c252ed27cf81 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:43.475614 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2f6fde5c-13fa-44dd-b5b1-c252ed27cf81 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:43.504573 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2f6fde5c-13fa-44dd-b5b1-c252ed27cf81 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1319 microversion: 2.1 time: 0.310401 Feb 08 17:33:43.512762 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 355/691] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:43 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:43.527317 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2c6383c7-61e4-4920-9780-f5408571d291 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:43.538837 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-69bc6883-e967-4c50-8759-bfa21739dac6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:43.539805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-69bc6883-e967-4c50-8759-bfa21739dac6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:43.549990 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2c6383c7-61e4-4920-9780-f5408571d291 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1318 microversion: 2.1 time: 0.561037 Feb 08 17:33:43.568817 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 337/692] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:42 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:43.572015 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69bc6883-e967-4c50-8759-bfa21739dac6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:43.577055 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69bc6883-e967-4c50-8759-bfa21739dac6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:43.578455 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69bc6883-e967-4c50-8759-bfa21739dac6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:43.578984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-69bc6883-e967-4c50-8759-bfa21739dac6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:43.616297 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-69bc6883-e967-4c50-8759-bfa21739dac6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] HTTP exception thrown: Instance c73f173b-bae7-44a2-b686-0179e64e9c30 could not be found. Feb 08 17:33:43.617787 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-69bc6883-e967-4c50-8759-bfa21739dac6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Returning 404 to user: Instance c73f173b-bae7-44a2-b686-0179e64e9c30 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:33:43.618789 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-69bc6883-e967-4c50-8759-bfa21739dac6 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 404 len: 111 microversion: 2.20 time: 0.083813 Feb 08 17:33:43.620151 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 356/693] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:43 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 08 17:33:43.636610 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-72829ef5-401c-4da9-8118-33a037127221 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '.version_select at 0x7fd9f9947f70>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:43.680134 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-72829ef5-401c-4da9-8118-33a037127221 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847212022" status: 204 len: 0 microversion: 2.20 time: 0.047469 Feb 08 17:33:43.680738 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 338/694] 10.222.0.69 () {60 vars in 1261 bytes} [Tue Feb 8 17:33:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847212022 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 08 17:33:44.209142 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-03799c91-effd-4479-99e5-20072d2e5719 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:44.213070 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-03799c91-effd-4479-99e5-20072d2e5719 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:44.234858 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-03799c91-effd-4479-99e5-20072d2e5719 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:44.241427 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-03799c91-effd-4479-99e5-20072d2e5719 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:44.249151 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-03799c91-effd-4479-99e5-20072d2e5719 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:44.250402 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-03799c91-effd-4479-99e5-20072d2e5719 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:44.296438 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-105bb9e6-3786-46ba-9ead-c9ce23d1b32a req-4b09a027-46a5-4cac-8ba0-124ec7930b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73830e35-4e4d-4ca1-a5db-75fe7400fc4c", "tag": "c0746dd4-2e81-48be-9572-611238bd7c8e"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:44.302117 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:33:44.302117 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:33:44.319641 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-105bb9e6-3786-46ba-9ead-c9ce23d1b32a req-4b09a027-46a5-4cac-8ba0-124ec7930b7b service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:44.326550 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-105bb9e6-3786-46ba-9ead-c9ce23d1b32a req-4b09a027-46a5-4cac-8ba0-124ec7930b7b service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:44.341776 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-105bb9e6-3786-46ba-9ead-c9ce23d1b32a req-4b09a027-46a5-4cac-8ba0-124ec7930b7b service nova] Creating event network-changed:c0746dd4-2e81-48be-9572-611238bd7c8e for instance 73830e35-4e4d-4ca1-a5db-75fe7400fc4c on hv-cinder-82204 Feb 08 17:33:44.361424 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-105bb9e6-3786-46ba-9ead-c9ce23d1b32a req-4b09a027-46a5-4cac-8ba0-124ec7930b7b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074564 Feb 08 17:33:44.367473 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 339/695] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:33:44.535141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b9172921-137a-4f04-af31-37a9633e98c9 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:44.539755 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b9172921-137a-4f04-af31-37a9633e98c9 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:44.558559 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b9172921-137a-4f04-af31-37a9633e98c9 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:44.559385 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b9172921-137a-4f04-af31-37a9633e98c9 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:44.560542 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b9172921-137a-4f04-af31-37a9633e98c9 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:44.565361 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b9172921-137a-4f04-af31-37a9633e98c9 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:44.655645 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-03799c91-effd-4479-99e5-20072d2e5719 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:44.681716 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-03799c91-effd-4479-99e5-20072d2e5719 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.475880 Feb 08 17:33:44.688921 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 357/696] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:44 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:44.723724 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2b8cec01-d352-451b-a2b2-b01c5e94ae0b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:44.725411 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2b8cec01-d352-451b-a2b2-b01c5e94ae0b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:44.741924 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b8cec01-d352-451b-a2b2-b01c5e94ae0b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:44.748771 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b8cec01-d352-451b-a2b2-b01c5e94ae0b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:44.753770 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b8cec01-d352-451b-a2b2-b01c5e94ae0b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:44.754977 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b8cec01-d352-451b-a2b2-b01c5e94ae0b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:45.008176 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b9172921-137a-4f04-af31-37a9633e98c9 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:45.027956 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b9172921-137a-4f04-af31-37a9633e98c9 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1319 microversion: 2.1 time: 0.498466 Feb 08 17:33:45.030438 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 340/697] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:44 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:45.302676 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2b8cec01-d352-451b-a2b2-b01c5e94ae0b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:45.330723 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2b8cec01-d352-451b-a2b2-b01c5e94ae0b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1318 microversion: 2.1 time: 0.624917 Feb 08 17:33:45.332551 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 358/698] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:44 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:45.354459 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4ed425eb-092b-4dd7-82c7-690b89dff1a0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Action: 'create', calling method: .version_select at 0x7fd9f9932670>, body: {"keypair": {"name": "tempest-keypair-1117351584"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:45.385514 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-4ed425eb-092b-4dd7-82c7-690b89dff1a0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:33:45.393304 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-4ed425eb-092b-4dd7-82c7-690b89dff1a0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for user 431b80f782ae4fd7962ca5e91fa7477f and project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:33:45.694263 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-4ed425eb-092b-4dd7-82c7-690b89dff1a0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:33:45.702159 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-4ed425eb-092b-4dd7-82c7-690b89dff1a0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for user 431b80f782ae4fd7962ca5e91fa7477f and project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:33:45.726581 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ac3a3ce4-cc89-48fb-8fec-733edb050f29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:45.727694 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ac3a3ce4-cc89-48fb-8fec-733edb050f29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:45.743649 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ac3a3ce4-cc89-48fb-8fec-733edb050f29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:45.744381 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ac3a3ce4-cc89-48fb-8fec-733edb050f29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:45.747732 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ac3a3ce4-cc89-48fb-8fec-733edb050f29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:45.747732 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ac3a3ce4-cc89-48fb-8fec-733edb050f29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:45.756966 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4ed425eb-092b-4dd7-82c7-690b89dff1a0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.409073 Feb 08 17:33:45.758420 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 341/699] 10.222.0.69 () {62 vars in 1198 bytes} [Tue Feb 8 17:33:45 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 412 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 08 17:33:46.062382 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-962420d6-b419-4229-833e-06b18252dbe8 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:46.064873 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-962420d6-b419-4229-833e-06b18252dbe8 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:46.080867 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-962420d6-b419-4229-833e-06b18252dbe8 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:46.082531 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-962420d6-b419-4229-833e-06b18252dbe8 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:46.084667 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-962420d6-b419-4229-833e-06b18252dbe8 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:46.085668 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-962420d6-b419-4229-833e-06b18252dbe8 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:46.108433 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ac3a3ce4-cc89-48fb-8fec-733edb050f29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:46.133837 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ac3a3ce4-cc89-48fb-8fec-733edb050f29 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.417719 Feb 08 17:33:46.134890 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 359/700] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:45 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:46.362563 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9ec95925-e7e1-4e52-9b12-ac4cfa35194a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:46.365352 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9ec95925-e7e1-4e52-9b12-ac4cfa35194a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:46.378293 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ec95925-e7e1-4e52-9b12-ac4cfa35194a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:46.378754 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ec95925-e7e1-4e52-9b12-ac4cfa35194a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:46.380625 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ec95925-e7e1-4e52-9b12-ac4cfa35194a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:46.381580 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9ec95925-e7e1-4e52-9b12-ac4cfa35194a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:46.459139 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-962420d6-b419-4229-833e-06b18252dbe8 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:46.479449 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-962420d6-b419-4229-833e-06b18252dbe8 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1319 microversion: 2.1 time: 0.427207 Feb 08 17:33:46.494934 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 342/701] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:46 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:46.643802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9ec95925-e7e1-4e52-9b12-ac4cfa35194a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:46.655198 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9ec95925-e7e1-4e52-9b12-ac4cfa35194a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1318 microversion: 2.1 time: 0.299582 Feb 08 17:33:46.656228 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 360/702] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:46 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:47.160512 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3160a045-2819-4331-bc39-50921006a1dc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:47.162640 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3160a045-2819-4331-bc39-50921006a1dc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:47.173679 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3160a045-2819-4331-bc39-50921006a1dc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:47.174483 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3160a045-2819-4331-bc39-50921006a1dc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:47.175839 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3160a045-2819-4331-bc39-50921006a1dc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:47.176636 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3160a045-2819-4331-bc39-50921006a1dc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:47.390328 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3160a045-2819-4331-bc39-50921006a1dc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:47.405934 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3160a045-2819-4331-bc39-50921006a1dc tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.252381 Feb 08 17:33:47.407331 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 343/703] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:47 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:47.508134 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5264326e-edcf-4c16-ab43-4b0a27a53a0a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:47.509434 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5264326e-edcf-4c16-ab43-4b0a27a53a0a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:47.518709 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5264326e-edcf-4c16-ab43-4b0a27a53a0a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:47.519401 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5264326e-edcf-4c16-ab43-4b0a27a53a0a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:47.520395 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5264326e-edcf-4c16-ab43-4b0a27a53a0a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:47.521099 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5264326e-edcf-4c16-ab43-4b0a27a53a0a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:47.682681 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-281d500c-b455-4097-922e-bef94b80a649 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:47.684810 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-281d500c-b455-4097-922e-bef94b80a649 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:47.695531 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-281d500c-b455-4097-922e-bef94b80a649 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:47.696192 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-281d500c-b455-4097-922e-bef94b80a649 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:47.697515 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-281d500c-b455-4097-922e-bef94b80a649 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:47.698374 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-281d500c-b455-4097-922e-bef94b80a649 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:47.844689 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5264326e-edcf-4c16-ab43-4b0a27a53a0a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:47.860657 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5264326e-edcf-4c16-ab43-4b0a27a53a0a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1319 microversion: 2.1 time: 0.355732 Feb 08 17:33:47.864823 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 361/704] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:47 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:47.968822 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-281d500c-b455-4097-922e-bef94b80a649 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:47.990571 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-281d500c-b455-4097-922e-bef94b80a649 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1318 microversion: 2.1 time: 0.312653 Feb 08 17:33:47.993478 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 344/705] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:47 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:48.062755 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-1d7a20cf-2432-4005-89a6-d0ba6dda1240 req-62a823b8-317d-4f6e-bd5b-647b31df8714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "538dbde7-2cb0-44ca-9f40-203e7a7764a3", "name": "network-vif-plugged", "status": "completed", "tag": "2ce2fd96-10b4-41ed-951a-837a866ac88e"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:48.066139 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:33:48.066139 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:33:48.082379 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-1d7a20cf-2432-4005-89a6-d0ba6dda1240 req-62a823b8-317d-4f6e-bd5b-647b31df8714 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:48.083145 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-1d7a20cf-2432-4005-89a6-d0ba6dda1240 req-62a823b8-317d-4f6e-bd5b-647b31df8714 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:48.103499 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-1d7a20cf-2432-4005-89a6-d0ba6dda1240 req-62a823b8-317d-4f6e-bd5b-647b31df8714 service nova] Creating event network-vif-plugged:2ce2fd96-10b4-41ed-951a-837a866ac88e for instance 538dbde7-2cb0-44ca-9f40-203e7a7764a3 on hv-cinder-82204 Feb 08 17:33:48.114100 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-1d7a20cf-2432-4005-89a6-d0ba6dda1240 req-62a823b8-317d-4f6e-bd5b-647b31df8714 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170055 Feb 08 17:33:48.115193 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 362/706] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:33:48.118196 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-675076845", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccd61454-4568-47e1-b525-83b47e7e5945"}], "security_groups": [{"name": "tempest-securitygroup--463437484"}], "key_name": "tempest-keypair-1117351584", "user_data": "}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:48.296806 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.network.neutron [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] validate_networks() for [('ccd61454-4568-47e1-b525-83b47e7e5945', None, None, None, None, None)] {{(pid=116479) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:33:48.432823 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-79cb448c-79e6-4cbb-9b25-137c96b4c9bd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:48.434279 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-79cb448c-79e6-4cbb-9b25-137c96b4c9bd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:48.444295 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79cb448c-79e6-4cbb-9b25-137c96b4c9bd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:48.444613 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79cb448c-79e6-4cbb-9b25-137c96b4c9bd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:48.445484 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79cb448c-79e6-4cbb-9b25-137c96b4c9bd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:48.446286 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79cb448c-79e6-4cbb-9b25-137c96b4c9bd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:48.686429 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-79cb448c-79e6-4cbb-9b25-137c96b4c9bd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:48.701569 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-79cb448c-79e6-4cbb-9b25-137c96b4c9bd tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.275470 Feb 08 17:33:48.702665 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 363/707] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:48 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:48.886606 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-314c0613-aa5f-4437-adaf-a90a8cefda58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:48.887666 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-314c0613-aa5f-4437-adaf-a90a8cefda58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:48.900464 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-314c0613-aa5f-4437-adaf-a90a8cefda58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:48.901143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-314c0613-aa5f-4437-adaf-a90a8cefda58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:48.902799 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-314c0613-aa5f-4437-adaf-a90a8cefda58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:48.904145 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-314c0613-aa5f-4437-adaf-a90a8cefda58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:49.107876 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Flavor limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:33:49.114026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Image limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:33:49.114026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Flavor pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:33:49.114026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Image pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:33:49.114026 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:33:49.126715 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:49.127516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:49.129337 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:49.130045 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:49.131900 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-314c0613-aa5f-4437-adaf-a90a8cefda58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:49.147092 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-314c0613-aa5f-4437-adaf-a90a8cefda58 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1319 microversion: 2.1 time: 0.264997 Feb 08 17:33:49.147773 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 364/708] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:48 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:49.155483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-91e7c3ca-e56e-47a8-a7db-8613d233be20 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:49.156466 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-91e7c3ca-e56e-47a8-a7db-8613d233be20 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:49.165618 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-91e7c3ca-e56e-47a8-a7db-8613d233be20 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:49.166311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-91e7c3ca-e56e-47a8-a7db-8613d233be20 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:49.167686 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-91e7c3ca-e56e-47a8-a7db-8613d233be20 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:49.168463 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-91e7c3ca-e56e-47a8-a7db-8613d233be20 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:49.168598 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:33:49.176353 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Getting quotas for user 431b80f782ae4fd7962ca5e91fa7477f and project 1db94ac5e06144fe93946c0c4df7e2ed. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:33:49.196094 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Going to run 1 instances... {{(pid=116479) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:33:49.198680 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:33:49.269686 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7ada4879-597a-486d-8ab3-c997967bcf1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.157310 Feb 08 17:33:49.271172 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 345/709] 10.222.0.69 () {62 vars in 1187 bytes} [Tue Feb 8 17:33:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 08 17:33:49.286095 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d9df072b-ded0-4a64-bd6f-f5b0250d2270 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:49.286970 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d9df072b-ded0-4a64-bd6f-f5b0250d2270 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:49.360665 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d9df072b-ded0-4a64-bd6f-f5b0250d2270 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:49.374073 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d9df072b-ded0-4a64-bd6f-f5b0250d2270 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:49.376630 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d9df072b-ded0-4a64-bd6f-f5b0250d2270 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:49.378378 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d9df072b-ded0-4a64-bd6f-f5b0250d2270 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1281 microversion: 2.20 time: 0.097951 Feb 08 17:33:49.381973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 346/710] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:49 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1281 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:33:49.404421 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-91e7c3ca-e56e-47a8-a7db-8613d233be20 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:49.416471 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-91e7c3ca-e56e-47a8-a7db-8613d233be20 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1318 microversion: 2.1 time: 0.267251 Feb 08 17:33:49.417474 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 365/711] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:49 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:49.723308 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-799f878b-7e13-4dca-8572-044d7f6becf2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:49.723989 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-799f878b-7e13-4dca-8572-044d7f6becf2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:49.730784 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-799f878b-7e13-4dca-8572-044d7f6becf2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:49.732171 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-799f878b-7e13-4dca-8572-044d7f6becf2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:49.733000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-799f878b-7e13-4dca-8572-044d7f6becf2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:49.733459 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-799f878b-7e13-4dca-8572-044d7f6becf2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:49.949943 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-799f878b-7e13-4dca-8572-044d7f6becf2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:49.963753 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-799f878b-7e13-4dca-8572-044d7f6becf2 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.244376 Feb 08 17:33:49.964747 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 347/712] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:49 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:50.172829 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9be5b677-d9a1-4d36-961b-55575f1ac9c1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:50.173476 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9be5b677-d9a1-4d36-961b-55575f1ac9c1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:50.185376 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9be5b677-d9a1-4d36-961b-55575f1ac9c1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:50.186133 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9be5b677-d9a1-4d36-961b-55575f1ac9c1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:50.187463 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9be5b677-d9a1-4d36-961b-55575f1ac9c1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:50.188305 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9be5b677-d9a1-4d36-961b-55575f1ac9c1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:50.382389 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9be5b677-d9a1-4d36-961b-55575f1ac9c1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:50.395450 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9be5b677-d9a1-4d36-961b-55575f1ac9c1 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1319 microversion: 2.1 time: 0.226208 Feb 08 17:33:50.396505 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 366/713] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:50 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:50.403887 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-15834a1a-04e5-403d-9862-5af86de5a08b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:50.405093 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-15834a1a-04e5-403d-9862-5af86de5a08b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:50.417139 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15834a1a-04e5-403d-9862-5af86de5a08b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:50.417985 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15834a1a-04e5-403d-9862-5af86de5a08b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:50.419472 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15834a1a-04e5-403d-9862-5af86de5a08b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:50.420271 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15834a1a-04e5-403d-9862-5af86de5a08b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:50.443305 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8bfa2c6c-f292-4578-b1b3-0f058ceb5361 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:50.444808 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8bfa2c6c-f292-4578-b1b3-0f058ceb5361 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:50.457891 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8bfa2c6c-f292-4578-b1b3-0f058ceb5361 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:50.458856 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8bfa2c6c-f292-4578-b1b3-0f058ceb5361 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:50.460439 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8bfa2c6c-f292-4578-b1b3-0f058ceb5361 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:50.461437 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8bfa2c6c-f292-4578-b1b3-0f058ceb5361 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:50.526980 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-15834a1a-04e5-403d-9862-5af86de5a08b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:50.540874 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-15834a1a-04e5-403d-9862-5af86de5a08b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:50.545063 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-15834a1a-04e5-403d-9862-5af86de5a08b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:50.547574 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-15834a1a-04e5-403d-9862-5af86de5a08b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1333 microversion: 2.20 time: 0.150619 Feb 08 17:33:50.548793 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 348/714] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:50 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1333 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:33:50.699709 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8bfa2c6c-f292-4578-b1b3-0f058ceb5361 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:50.712314 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8bfa2c6c-f292-4578-b1b3-0f058ceb5361 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1318 microversion: 2.1 time: 0.275620 Feb 08 17:33:50.713902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 367/715] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:50 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:50.984641 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ebc24681-06d0-4d99-ab37-61720e37162f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:50.985296 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ebc24681-06d0-4d99-ab37-61720e37162f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:50.998907 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ebc24681-06d0-4d99-ab37-61720e37162f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:50.999646 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ebc24681-06d0-4d99-ab37-61720e37162f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.001137 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ebc24681-06d0-4d99-ab37-61720e37162f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.001872 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ebc24681-06d0-4d99-ab37-61720e37162f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.210606 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2b654373-b97e-4a18-b1b2-f8796414188d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:51.212357 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2b654373-b97e-4a18-b1b2-f8796414188d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:51.223993 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b654373-b97e-4a18-b1b2-f8796414188d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.224791 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b654373-b97e-4a18-b1b2-f8796414188d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.226627 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b654373-b97e-4a18-b1b2-f8796414188d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.227011 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b654373-b97e-4a18-b1b2-f8796414188d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.285383 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2b654373-b97e-4a18-b1b2-f8796414188d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081481 Feb 08 17:33:51.286879 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 368/716] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:33:51 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 08 17:33:51.354478 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ebc24681-06d0-4d99-ab37-61720e37162f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:51.367896 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ebc24681-06d0-4d99-ab37-61720e37162f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.387427 Feb 08 17:33:51.369383 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 349/717] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:50 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:51.369748 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a83887d3-67cd-4f45-a835-a9cc0889a3e9 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:51.371251 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a83887d3-67cd-4f45-a835-a9cc0889a3e9 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:51.383601 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a83887d3-67cd-4f45-a835-a9cc0889a3e9 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.384576 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a83887d3-67cd-4f45-a835-a9cc0889a3e9 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.386116 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a83887d3-67cd-4f45-a835-a9cc0889a3e9 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.386926 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a83887d3-67cd-4f45-a835-a9cc0889a3e9 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.426918 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-9b31e0fd-da7b-4124-b930-9d6a2afc7c1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:51.428059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a83887d3-67cd-4f45-a835-a9cc0889a3e9 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:33:51.428506 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-9b31e0fd-da7b-4124-b930-9d6a2afc7c1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:51.441112 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9b31e0fd-da7b-4124-b930-9d6a2afc7c1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.442292 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9b31e0fd-da7b-4124-b930-9d6a2afc7c1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.444018 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9b31e0fd-da7b-4124-b930-9d6a2afc7c1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.444875 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9b31e0fd-da7b-4124-b930-9d6a2afc7c1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.586059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a83887d3-67cd-4f45-a835-a9cc0889a3e9 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 204 len: 0 microversion: 2.1 time: 0.221729 Feb 08 17:33:51.589491 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 369/718] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:33:51 2022] DELETE /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 08 17:33:51.599877 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e2ac78fb-63cc-4dea-806e-46330e177371 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:51.600706 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e2ac78fb-63cc-4dea-806e-46330e177371 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:51.613223 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e2ac78fb-63cc-4dea-806e-46330e177371 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.613952 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e2ac78fb-63cc-4dea-806e-46330e177371 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.614832 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e2ac78fb-63cc-4dea-806e-46330e177371 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.615567 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e2ac78fb-63cc-4dea-806e-46330e177371 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.739372 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e2ac78fb-63cc-4dea-806e-46330e177371 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:51.757242 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e2ac78fb-63cc-4dea-806e-46330e177371 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:51.760275 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e2ac78fb-63cc-4dea-806e-46330e177371 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:51.763000 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e2ac78fb-63cc-4dea-806e-46330e177371 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1339 microversion: 2.20 time: 0.170297 Feb 08 17:33:51.774015 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 370/719] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:51 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1339 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:33:51.774015 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b24d4f7b-cb3d-41ab-b4b6-c4e9432e6283 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:51.774015 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-b24d4f7b-cb3d-41ab-b4b6-c4e9432e6283 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:51.780259 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-9b31e0fd-da7b-4124-b930-9d6a2afc7c1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:51.795486 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b24d4f7b-cb3d-41ab-b4b6-c4e9432e6283 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.796517 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-9b31e0fd-da7b-4124-b930-9d6a2afc7c1c tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1508 microversion: 2.1 time: 0.376961 Feb 08 17:33:51.796738 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b24d4f7b-cb3d-41ab-b4b6-c4e9432e6283 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.798123 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b24d4f7b-cb3d-41ab-b4b6-c4e9432e6283 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.798648 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 350/720] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:51 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:51.798844 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b24d4f7b-cb3d-41ab-b4b6-c4e9432e6283 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.806874 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ddbc1163-0b08-40ac-966d-4386c62ac55e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:51.808226 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ddbc1163-0b08-40ac-966d-4386c62ac55e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:51.821662 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ddbc1163-0b08-40ac-966d-4386c62ac55e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.822336 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ddbc1163-0b08-40ac-966d-4386c62ac55e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:51.823738 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ddbc1163-0b08-40ac-966d-4386c62ac55e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:51.825327 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ddbc1163-0b08-40ac-966d-4386c62ac55e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:52.052569 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b24d4f7b-cb3d-41ab-b4b6-c4e9432e6283 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:52.067310 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b24d4f7b-cb3d-41ab-b4b6-c4e9432e6283 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1672 microversion: 2.1 time: 0.302123 Feb 08 17:33:52.068217 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 371/721] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:51 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1672 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:52.077289 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-03d56fdd-0478-4a0f-9548-9e4aa1d25a91 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a0a14bb-e07d-4ff9-a502-08fa5eb4db4d", "device": "/dev/sdb"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:52.079831 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-03d56fdd-0478-4a0f-9548-9e4aa1d25a91 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:52.087648 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-03d56fdd-0478-4a0f-9548-9e4aa1d25a91 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:52.088204 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-03d56fdd-0478-4a0f-9548-9e4aa1d25a91 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:52.089581 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-03d56fdd-0478-4a0f-9548-9e4aa1d25a91 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:52.090186 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-03d56fdd-0478-4a0f-9548-9e4aa1d25a91 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:52.186196 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ddbc1163-0b08-40ac-966d-4386c62ac55e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:52.201499 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ddbc1163-0b08-40ac-966d-4386c62ac55e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1318 microversion: 2.1 time: 0.400639 Feb 08 17:33:52.203547 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 351/722] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:51 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:52.225744 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-9a295268-7f44-4be9-901c-c06b04844576 req-91176fe4-58b2-4c8b-9d00-d3e92b517f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73830e35-4e4d-4ca1-a5db-75fe7400fc4c", "name": "network-vif-plugged", "status": "completed", "tag": "c0746dd4-2e81-48be-9572-611238bd7c8e"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:52.228459 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:33:52.228459 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:33:52.245086 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-9a295268-7f44-4be9-901c-c06b04844576 req-91176fe4-58b2-4c8b-9d00-d3e92b517f5a service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:52.245779 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-9a295268-7f44-4be9-901c-c06b04844576 req-91176fe4-58b2-4c8b-9d00-d3e92b517f5a service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:52.268036 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-9a295268-7f44-4be9-901c-c06b04844576 req-91176fe4-58b2-4c8b-9d00-d3e92b517f5a service nova] Creating event network-vif-plugged:c0746dd4-2e81-48be-9572-611238bd7c8e for instance 73830e35-4e4d-4ca1-a5db-75fe7400fc4c on hv-cinder-82204 Feb 08 17:33:52.281028 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-9a295268-7f44-4be9-901c-c06b04844576 req-91176fe4-58b2-4c8b-9d00-d3e92b517f5a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059103 Feb 08 17:33:52.282629 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 352/723] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:33:52.399308 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-dfd69d4e-3bd4-4076-9ab9-1356661d4a93 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:52.402719 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-dfd69d4e-3bd4-4076-9ab9-1356661d4a93 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:52.415631 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dfd69d4e-3bd4-4076-9ab9-1356661d4a93 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:52.416395 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dfd69d4e-3bd4-4076-9ab9-1356661d4a93 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:52.417499 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dfd69d4e-3bd4-4076-9ab9-1356661d4a93 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:52.418185 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dfd69d4e-3bd4-4076-9ab9-1356661d4a93 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:52.531637 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-03d56fdd-0478-4a0f-9548-9e4aa1d25a91 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "POST /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461226 Feb 08 17:33:52.532720 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 372/724] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:33:52 2022] POST /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3/os-volume_attachments => generated 194 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:33:52.808389 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-65fea0b4-5fec-4236-a209-0dff70f297c3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:52.810824 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-65fea0b4-5fec-4236-a209-0dff70f297c3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:52.821526 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-65fea0b4-5fec-4236-a209-0dff70f297c3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:52.822486 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-65fea0b4-5fec-4236-a209-0dff70f297c3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:52.824329 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-65fea0b4-5fec-4236-a209-0dff70f297c3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:52.826043 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-65fea0b4-5fec-4236-a209-0dff70f297c3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:52.996995 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-dfd69d4e-3bd4-4076-9ab9-1356661d4a93 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:53.014615 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-dfd69d4e-3bd4-4076-9ab9-1356661d4a93 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.623791 Feb 08 17:33:53.015733 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 353/725] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:52 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:53.047868 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-65fea0b4-5fec-4236-a209-0dff70f297c3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:53.064622 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-65fea0b4-5fec-4236-a209-0dff70f297c3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:53.067359 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-65fea0b4-5fec-4236-a209-0dff70f297c3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:53.069581 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-65fea0b4-5fec-4236-a209-0dff70f297c3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.271248 Feb 08 17:33:53.070732 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 373/726] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:52 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:33:53.094884 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-34202aab-1b02-4f7c-b6d9-68f2b5bf610a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:53.096041 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-34202aab-1b02-4f7c-b6d9-68f2b5bf610a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:53.107473 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-34202aab-1b02-4f7c-b6d9-68f2b5bf610a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:53.108292 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-34202aab-1b02-4f7c-b6d9-68f2b5bf610a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:53.109782 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-34202aab-1b02-4f7c-b6d9-68f2b5bf610a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:53.111056 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-34202aab-1b02-4f7c-b6d9-68f2b5bf610a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:53.234411 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e7b9ec8b-6882-4e61-854c-fa534ae837a7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:53.236024 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e7b9ec8b-6882-4e61-854c-fa534ae837a7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:53.249912 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e7b9ec8b-6882-4e61-854c-fa534ae837a7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:53.251235 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e7b9ec8b-6882-4e61-854c-fa534ae837a7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:53.252495 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e7b9ec8b-6882-4e61-854c-fa534ae837a7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:53.253463 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e7b9ec8b-6882-4e61-854c-fa534ae837a7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:53.471046 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-34202aab-1b02-4f7c-b6d9-68f2b5bf610a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:53.483920 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-34202aab-1b02-4f7c-b6d9-68f2b5bf610a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1672 microversion: 2.1 time: 0.396263 Feb 08 17:33:53.484953 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 354/727] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:53 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1672 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:53.525131 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e7b9ec8b-6882-4e61-854c-fa534ae837a7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:53.546206 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e7b9ec8b-6882-4e61-854c-fa534ae837a7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1318 microversion: 2.1 time: 0.317873 Feb 08 17:33:53.553226 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 374/728] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:53 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:53.579485 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-5a900a0f-db1d-4dc3-b355-eb25855def30 req-c4f8b7ec-bd45-4c25-be7d-d1a2b7627375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9897ad7c-5c82-4c2d-ad35-d99660e7a347", "tag": "a4c518af-c3fe-4c2a-bf7f-55f78233f5e9"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:53.581077 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:33:53.581077 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:33:53.589670 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-5a900a0f-db1d-4dc3-b355-eb25855def30 req-c4f8b7ec-bd45-4c25-be7d-d1a2b7627375 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:53.590598 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-5a900a0f-db1d-4dc3-b355-eb25855def30 req-c4f8b7ec-bd45-4c25-be7d-d1a2b7627375 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:53.619508 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-5a900a0f-db1d-4dc3-b355-eb25855def30 req-c4f8b7ec-bd45-4c25-be7d-d1a2b7627375 service nova] Creating event network-changed:a4c518af-c3fe-4c2a-bf7f-55f78233f5e9 for instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 on hv-cinder-82204 Feb 08 17:33:53.632339 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-5a900a0f-db1d-4dc3-b355-eb25855def30 req-c4f8b7ec-bd45-4c25-be7d-d1a2b7627375 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055802 Feb 08 17:33:53.634193 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 355/729] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:33:54.045369 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e84eb6f6-5c59-4611-a250-d0f7f6d5361a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:54.046701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e84eb6f6-5c59-4611-a250-d0f7f6d5361a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:54.058342 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e84eb6f6-5c59-4611-a250-d0f7f6d5361a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:54.059163 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e84eb6f6-5c59-4611-a250-d0f7f6d5361a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:54.060580 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e84eb6f6-5c59-4611-a250-d0f7f6d5361a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:54.061405 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e84eb6f6-5c59-4611-a250-d0f7f6d5361a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:54.104516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-807a70a0-b617-47b9-bc4d-7868b23fa640 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:54.112782 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-807a70a0-b617-47b9-bc4d-7868b23fa640 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:54.124957 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-807a70a0-b617-47b9-bc4d-7868b23fa640 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:54.125792 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-807a70a0-b617-47b9-bc4d-7868b23fa640 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:54.127901 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-807a70a0-b617-47b9-bc4d-7868b23fa640 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:54.128761 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-807a70a0-b617-47b9-bc4d-7868b23fa640 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:54.313142 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e84eb6f6-5c59-4611-a250-d0f7f6d5361a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:54.329009 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e84eb6f6-5c59-4611-a250-d0f7f6d5361a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.291280 Feb 08 17:33:54.330081 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 375/730] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:54 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:54.451850 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-807a70a0-b617-47b9-bc4d-7868b23fa640 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:54.462730 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-807a70a0-b617-47b9-bc4d-7868b23fa640 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:54.466293 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-807a70a0-b617-47b9-bc4d-7868b23fa640 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:54.468394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-807a70a0-b617-47b9-bc4d-7868b23fa640 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.370955 Feb 08 17:33:54.469723 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 356/731] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:54 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:33:54.504155 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8325671f-1e80-4e80-997b-da5465be16fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:54.505237 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8325671f-1e80-4e80-997b-da5465be16fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:54.514130 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8325671f-1e80-4e80-997b-da5465be16fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:54.514725 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8325671f-1e80-4e80-997b-da5465be16fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:54.515856 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8325671f-1e80-4e80-997b-da5465be16fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:54.516342 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8325671f-1e80-4e80-997b-da5465be16fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:54.572721 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-dc5a9e81-e084-49af-9948-d0801d6e646c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:54.573273 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-dc5a9e81-e084-49af-9948-d0801d6e646c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:54.580926 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc5a9e81-e084-49af-9948-d0801d6e646c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:54.581421 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc5a9e81-e084-49af-9948-d0801d6e646c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:54.582218 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc5a9e81-e084-49af-9948-d0801d6e646c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:54.582828 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-dc5a9e81-e084-49af-9948-d0801d6e646c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:54.733812 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8325671f-1e80-4e80-997b-da5465be16fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:54.748190 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8325671f-1e80-4e80-997b-da5465be16fb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1672 microversion: 2.1 time: 0.248926 Feb 08 17:33:54.749279 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 376/732] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:54 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1672 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:54.979657 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-dc5a9e81-e084-49af-9948-d0801d6e646c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:54.999978 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-dc5a9e81-e084-49af-9948-d0801d6e646c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1318 microversion: 2.1 time: 0.430992 Feb 08 17:33:55.000947 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 357/733] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:54 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:55.362438 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e8db9d89-7ce5-4820-8ed9-02f0e3fbdd6a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:55.363972 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e8db9d89-7ce5-4820-8ed9-02f0e3fbdd6a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:55.376659 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e8db9d89-7ce5-4820-8ed9-02f0e3fbdd6a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:55.377545 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e8db9d89-7ce5-4820-8ed9-02f0e3fbdd6a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:55.379019 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e8db9d89-7ce5-4820-8ed9-02f0e3fbdd6a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:55.379838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e8db9d89-7ce5-4820-8ed9-02f0e3fbdd6a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:55.499741 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-eba08817-7d62-4886-a22d-e1eeb6ae6a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:55.500772 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-eba08817-7d62-4886-a22d-e1eeb6ae6a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:55.511400 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-eba08817-7d62-4886-a22d-e1eeb6ae6a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:55.512615 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-eba08817-7d62-4886-a22d-e1eeb6ae6a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:55.514122 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-eba08817-7d62-4886-a22d-e1eeb6ae6a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:55.514909 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-eba08817-7d62-4886-a22d-e1eeb6ae6a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:55.634336 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e8db9d89-7ce5-4820-8ed9-02f0e3fbdd6a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:55.644350 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e8db9d89-7ce5-4820-8ed9-02f0e3fbdd6a tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.290157 Feb 08 17:33:55.645218 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 377/734] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:55 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:55.750260 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-eba08817-7d62-4886-a22d-e1eeb6ae6a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:55.762778 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-eba08817-7d62-4886-a22d-e1eeb6ae6a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:55.764394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-eba08817-7d62-4886-a22d-e1eeb6ae6a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:55.765778 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-eba08817-7d62-4886-a22d-e1eeb6ae6a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.273552 Feb 08 17:33:55.766397 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 358/735] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:55 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:33:55.778699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d5e3d229-f8a9-4c81-9bed-b27084f7d5c4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:55.779837 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d5e3d229-f8a9-4c81-9bed-b27084f7d5c4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:55.788385 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d5e3d229-f8a9-4c81-9bed-b27084f7d5c4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:55.788913 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d5e3d229-f8a9-4c81-9bed-b27084f7d5c4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:55.789864 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d5e3d229-f8a9-4c81-9bed-b27084f7d5c4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:55.790385 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d5e3d229-f8a9-4c81-9bed-b27084f7d5c4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:55.999212 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d5e3d229-f8a9-4c81-9bed-b27084f7d5c4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:56.013257 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d5e3d229-f8a9-4c81-9bed-b27084f7d5c4 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1672 microversion: 2.1 time: 0.241957 Feb 08 17:33:56.025249 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 378/736] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:55 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1672 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:56.025502 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c4f49341-01a0-49d4-9fab-b8226e17b848 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:56.025502 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c4f49341-01a0-49d4-9fab-b8226e17b848 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:56.034270 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c4f49341-01a0-49d4-9fab-b8226e17b848 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:56.035058 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c4f49341-01a0-49d4-9fab-b8226e17b848 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:56.036619 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c4f49341-01a0-49d4-9fab-b8226e17b848 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:56.037436 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c4f49341-01a0-49d4-9fab-b8226e17b848 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:56.334635 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-c4f49341-01a0-49d4-9fab-b8226e17b848 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:56.343249 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c4f49341-01a0-49d4-9fab-b8226e17b848 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1506 microversion: 2.1 time: 0.329148 Feb 08 17:33:56.343846 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 359/737] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:56 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:56.688150 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8586a73d-b2e3-468f-912e-8ffda3e326c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:56.689218 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8586a73d-b2e3-468f-912e-8ffda3e326c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:56.711835 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8586a73d-b2e3-468f-912e-8ffda3e326c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:56.712541 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8586a73d-b2e3-468f-912e-8ffda3e326c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:56.714221 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8586a73d-b2e3-468f-912e-8ffda3e326c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:56.715147 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8586a73d-b2e3-468f-912e-8ffda3e326c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:56.799098 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-953106e8-07c2-4781-817c-0af319ebafff tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:56.801013 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-953106e8-07c2-4781-817c-0af319ebafff tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:56.814157 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-953106e8-07c2-4781-817c-0af319ebafff tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:56.815688 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-953106e8-07c2-4781-817c-0af319ebafff tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:56.816993 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-953106e8-07c2-4781-817c-0af319ebafff tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:56.817743 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-953106e8-07c2-4781-817c-0af319ebafff tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:56.967786 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8586a73d-b2e3-468f-912e-8ffda3e326c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:56.996723 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8586a73d-b2e3-468f-912e-8ffda3e326c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1755 microversion: 2.1 time: 0.316460 Feb 08 17:33:56.997683 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 379/738] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:56 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1755 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:57.036207 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c5f5243f-653d-43db-82a8-e419d415a48f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:57.037097 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c5f5243f-653d-43db-82a8-e419d415a48f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:57.045126 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c5f5243f-653d-43db-82a8-e419d415a48f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:57.045735 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c5f5243f-653d-43db-82a8-e419d415a48f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:57.046683 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c5f5243f-653d-43db-82a8-e419d415a48f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:57.047354 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c5f5243f-653d-43db-82a8-e419d415a48f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:57.228744 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-953106e8-07c2-4781-817c-0af319ebafff tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:57.258141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-953106e8-07c2-4781-817c-0af319ebafff tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:57.270301 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-953106e8-07c2-4781-817c-0af319ebafff tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:57.275378 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-953106e8-07c2-4781-817c-0af319ebafff tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.478992 Feb 08 17:33:57.278909 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 360/739] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:56 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:33:57.323197 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c5f5243f-653d-43db-82a8-e419d415a48f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:57.335513 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c5f5243f-653d-43db-82a8-e419d415a48f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1672 microversion: 2.1 time: 0.303568 Feb 08 17:33:57.336557 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 380/740] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:57 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1672 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:57.681571 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-96c11141-87ad-4264-b04d-63e1d31113c0 req-b55103cd-df1c-45a5-99be-4c466daef923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8921a8f3-fa2c-43e4-90fa-a8a936c1eda0", "name": "network-vif-deleted", "tag": "998b80e9-4624-47bb-91e8-25b96f1bc969"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:57.684382 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:33:57.684382 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:33:57.695815 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-96c11141-87ad-4264-b04d-63e1d31113c0 req-b55103cd-df1c-45a5-99be-4c466daef923 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:57.696295 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-96c11141-87ad-4264-b04d-63e1d31113c0 req-b55103cd-df1c-45a5-99be-4c466daef923 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:57.709395 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-96c11141-87ad-4264-b04d-63e1d31113c0 req-b55103cd-df1c-45a5-99be-4c466daef923 service nova] Creating event network-vif-deleted:998b80e9-4624-47bb-91e8-25b96f1bc969 for instance 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 on hv-cinder-82204 Feb 08 17:33:57.714707 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-96c11141-87ad-4264-b04d-63e1d31113c0 req-b55103cd-df1c-45a5-99be-4c466daef923 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037089 Feb 08 17:33:57.719302 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 361/741] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:33:57.857142 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4d483692-75c1-479e-82a0-5b3d005bf381 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "170b5bbe-a92c-41cf-a58e-03a48d46f308"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:33:57.860478 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4d483692-75c1-479e-82a0-5b3d005bf381 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:57.875205 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4d483692-75c1-479e-82a0-5b3d005bf381 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:57.876003 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4d483692-75c1-479e-82a0-5b3d005bf381 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:57.883201 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4d483692-75c1-479e-82a0-5b3d005bf381 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:57.884565 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4d483692-75c1-479e-82a0-5b3d005bf381 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:58.025880 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d8307877-98fd-43d1-ab6b-636fe8b842fb tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:58.028365 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d8307877-98fd-43d1-ab6b-636fe8b842fb tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:58.042318 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d8307877-98fd-43d1-ab6b-636fe8b842fb tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:58.043078 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d8307877-98fd-43d1-ab6b-636fe8b842fb tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:58.045151 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d8307877-98fd-43d1-ab6b-636fe8b842fb tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:58.046198 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d8307877-98fd-43d1-ab6b-636fe8b842fb tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:58.327854 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d8307877-98fd-43d1-ab6b-636fe8b842fb tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:58.338751 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d8307877-98fd-43d1-ab6b-636fe8b842fb tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1758 microversion: 2.1 time: 0.319952 Feb 08 17:33:58.339287 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 362/742] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:58 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1758 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:33:58.347282 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-87ba64e2-50e4-4bd2-b137-b191acbd9564 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:58.348174 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-87ba64e2-50e4-4bd2-b137-b191acbd9564 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:58.358256 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4d483692-75c1-479e-82a0-5b3d005bf381 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "POST /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507857 Feb 08 17:33:58.367288 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 381/743] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:33:57 2022] POST /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:33:58.367288 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-89cbf3c8-3961-4411-9f52-ac82fe74e0bd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:58.368245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-87ba64e2-50e4-4bd2-b137-b191acbd9564 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:58.368706 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-87ba64e2-50e4-4bd2-b137-b191acbd9564 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:58.369705 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-87ba64e2-50e4-4bd2-b137-b191acbd9564 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:58.370241 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-87ba64e2-50e4-4bd2-b137-b191acbd9564 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:58.372411 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-89cbf3c8-3961-4411-9f52-ac82fe74e0bd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:58.388489 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89cbf3c8-3961-4411-9f52-ac82fe74e0bd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:58.389554 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89cbf3c8-3961-4411-9f52-ac82fe74e0bd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:58.391076 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89cbf3c8-3961-4411-9f52-ac82fe74e0bd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:58.392177 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89cbf3c8-3961-4411-9f52-ac82fe74e0bd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:58.457819 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89cbf3c8-3961-4411-9f52-ac82fe74e0bd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:58.458609 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89cbf3c8-3961-4411-9f52-ac82fe74e0bd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:58.459513 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-89cbf3c8-3961-4411-9f52-ac82fe74e0bd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lazy-loading 'fault' on Instance uuid 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:33:58.528869 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-89cbf3c8-3961-4411-9f52-ac82fe74e0bd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:58.544129 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-89cbf3c8-3961-4411-9f52-ac82fe74e0bd tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 200 len: 1327 microversion: 2.1 time: 0.181807 Feb 08 17:33:58.546308 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 382/744] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:58 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 1327 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:33:58.697994 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-87ba64e2-50e4-4bd2-b137-b191acbd9564 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:58.714679 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-87ba64e2-50e4-4bd2-b137-b191acbd9564 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:58.717727 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-87ba64e2-50e4-4bd2-b137-b191acbd9564 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:33:58.719362 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-87ba64e2-50e4-4bd2-b137-b191acbd9564 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.375628 Feb 08 17:33:58.721200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 363/745] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:58 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:33:59.570403 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-25a98fd6-98e4-419b-845d-04f51a98ff44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:59.571684 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-25a98fd6-98e4-419b-845d-04f51a98ff44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:59.581880 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25a98fd6-98e4-419b-845d-04f51a98ff44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:59.582630 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25a98fd6-98e4-419b-845d-04f51a98ff44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:59.583941 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25a98fd6-98e4-419b-845d-04f51a98ff44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:59.584650 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25a98fd6-98e4-419b-845d-04f51a98ff44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:59.609572 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-25a98fd6-98e4-419b-845d-04f51a98ff44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] HTTP exception thrown: Instance 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 could not be found. Feb 08 17:33:59.610543 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-25a98fd6-98e4-419b-845d-04f51a98ff44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Returning 404 to user: Instance 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:33:59.611838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-25a98fd6-98e4-419b-845d-04f51a98ff44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 404 len: 111 microversion: 2.1 time: 0.047507 Feb 08 17:33:59.612945 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 383/746] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:33:59 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 17:33:59.626691 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e7631146-1ec2-4a7e-9dba-c78d105d5375 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '.version_select at 0x7fd9f9932670>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:59.652497 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e7631146-1ec2-4a7e-9dba-c78d105d5375 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038215287" status: 202 len: 0 microversion: 2.1 time: 0.032354 Feb 08 17:33:59.658450 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 364/747] 10.222.0.69 () {58 vars in 1220 bytes} [Tue Feb 8 17:33:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038215287 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:33:59.756054 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-cca906bc-8b23-4167-9d60-6cf3cb2e51d5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:33:59.757535 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-cca906bc-8b23-4167-9d60-6cf3cb2e51d5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:33:59.771733 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cca906bc-8b23-4167-9d60-6cf3cb2e51d5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:59.774160 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cca906bc-8b23-4167-9d60-6cf3cb2e51d5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:33:59.776707 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cca906bc-8b23-4167-9d60-6cf3cb2e51d5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:33:59.777767 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cca906bc-8b23-4167-9d60-6cf3cb2e51d5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:00.159360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-cca906bc-8b23-4167-9d60-6cf3cb2e51d5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:00.173935 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-cca906bc-8b23-4167-9d60-6cf3cb2e51d5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:00.176494 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-cca906bc-8b23-4167-9d60-6cf3cb2e51d5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:00.178345 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-cca906bc-8b23-4167-9d60-6cf3cb2e51d5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.432970 Feb 08 17:34:00.179264 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 384/748] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:33:59 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:34:00.793321 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8cb58d08-8603-4627-91dc-725ee148752d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Action: 'create', calling method: .version_select at 0x7fd9f9999550>, body: {"keypair": {"name": "tempest-keypair-1736230992"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:00.813958 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-8cb58d08-8603-4627-91dc-725ee148752d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:34:00.818547 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-8cb58d08-8603-4627-91dc-725ee148752d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for user 9d0970b8e8ce4ef5853e58cfdd797ec8 and project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:34:00.993979 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-8cb58d08-8603-4627-91dc-725ee148752d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:34:00.997954 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-8cb58d08-8603-4627-91dc-725ee148752d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for user 9d0970b8e8ce4ef5853e58cfdd797ec8 and project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:34:01.012517 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8cb58d08-8603-4627-91dc-725ee148752d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.225129 Feb 08 17:34:01.013149 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 365/749] 10.222.0.69 () {60 vars in 1157 bytes} [Tue Feb 8 17:34:00 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:34:01.211097 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ee1adb83-d3e0-48fb-bd49-f0ed9aab4c92 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:01.212233 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ee1adb83-d3e0-48fb-bd49-f0ed9aab4c92 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:01.224144 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ee1adb83-d3e0-48fb-bd49-f0ed9aab4c92 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:01.225037 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ee1adb83-d3e0-48fb-bd49-f0ed9aab4c92 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:01.226555 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ee1adb83-d3e0-48fb-bd49-f0ed9aab4c92 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:01.227403 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ee1adb83-d3e0-48fb-bd49-f0ed9aab4c92 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:01.493741 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ee1adb83-d3e0-48fb-bd49-f0ed9aab4c92 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:01.510325 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ee1adb83-d3e0-48fb-bd49-f0ed9aab4c92 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:01.514294 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ee1adb83-d3e0-48fb-bd49-f0ed9aab4c92 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:01.516396 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ee1adb83-d3e0-48fb-bd49-f0ed9aab4c92 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.312854 Feb 08 17:34:01.517445 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 385/750] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:01 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:34:02.547346 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-513c877b-9da8-47b8-8043-71c93014957c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:02.548545 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-513c877b-9da8-47b8-8043-71c93014957c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:02.571025 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-513c877b-9da8-47b8-8043-71c93014957c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:02.571025 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-513c877b-9da8-47b8-8043-71c93014957c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:02.571508 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-513c877b-9da8-47b8-8043-71c93014957c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:02.572170 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-513c877b-9da8-47b8-8043-71c93014957c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:02.893942 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-513c877b-9da8-47b8-8043-71c93014957c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:02.906614 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-513c877b-9da8-47b8-8043-71c93014957c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:02.908225 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-513c877b-9da8-47b8-8043-71c93014957c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:02.909786 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-513c877b-9da8-47b8-8043-71c93014957c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.371138 Feb 08 17:34:02.910439 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 366/751] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:02 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:34:02.911940 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1736239636", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f53cffab-2cd9-4d72-a0c8-7ee042426cd4"}], "security_groups": [{"name": "tempest-securitygroup--43692814"}], "key_name": "tempest-keypair-1736230992", "user_data": "}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:03.064765 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.network.neutron [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] validate_networks() for [('f53cffab-2cd9-4d72-a0c8-7ee042426cd4', None, None, None, None, None)] {{(pid=116480) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:34:03.622977 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Flavor limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:34:03.623720 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Image limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:34:03.624610 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Flavor pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:34:03.625521 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Image pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:34:03.626344 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:34:03.645659 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:03.647577 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:03.649693 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:03.649693 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:03.678763 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:34:03.686789 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Getting quotas for user 9d0970b8e8ce4ef5853e58cfdd797ec8 and project 7fedeb21bf7b4056b1737c6e7ddc2d2a. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:34:03.709691 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Going to run 1 instances... {{(pid=116480) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:34:03.714313 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116480) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:34:03.796398 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-177c6046-86bd-4877-8063-09d766a21caa tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.891587 Feb 08 17:34:03.797487 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 386/752] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:34:02 2022] POST /compute/v2.1/servers => generated 400 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:34:03.815982 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-550e8f36-f55d-49a5-b4e6-ef3effd9a8cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:03.816841 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-550e8f36-f55d-49a5-b4e6-ef3effd9a8cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:03.899744 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-550e8f36-f55d-49a5-b4e6-ef3effd9a8cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:03.908811 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-550e8f36-f55d-49a5-b4e6-ef3effd9a8cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1238 microversion: 2.1 time: 0.101536 Feb 08 17:34:03.909624 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 367/753] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:03 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:03.935774 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-413ad104-9f8f-426b-918e-63771e00b3dd tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:03.936768 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-413ad104-9f8f-426b-918e-63771e00b3dd tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:03.948503 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-413ad104-9f8f-426b-918e-63771e00b3dd tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:03.950419 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-413ad104-9f8f-426b-918e-63771e00b3dd tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:03.951581 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-413ad104-9f8f-426b-918e-63771e00b3dd tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:03.953262 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-413ad104-9f8f-426b-918e-63771e00b3dd tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:04.172104 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-413ad104-9f8f-426b-918e-63771e00b3dd tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:04.187473 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-413ad104-9f8f-426b-918e-63771e00b3dd tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:04.190403 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-413ad104-9f8f-426b-918e-63771e00b3dd tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:04.192500 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-413ad104-9f8f-426b-918e-63771e00b3dd tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.264189 Feb 08 17:34:04.193534 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 387/754] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:03 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:34:04.619180 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-1e89a51c-ce81-49ee-a273-a26e21d86065 req-b7c5c59b-c0c3-441e-9dbc-3f633cb6dec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9897ad7c-5c82-4c2d-ad35-d99660e7a347", "name": "network-vif-plugged", "status": "completed", "tag": "a4c518af-c3fe-4c2a-bf7f-55f78233f5e9"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:04.621840 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:34:04.621840 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:34:04.640471 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-1e89a51c-ce81-49ee-a273-a26e21d86065 req-b7c5c59b-c0c3-441e-9dbc-3f633cb6dec8 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:04.641054 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-1e89a51c-ce81-49ee-a273-a26e21d86065 req-b7c5c59b-c0c3-441e-9dbc-3f633cb6dec8 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:04.663576 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-1e89a51c-ce81-49ee-a273-a26e21d86065 req-b7c5c59b-c0c3-441e-9dbc-3f633cb6dec8 service nova] Creating event network-vif-plugged:a4c518af-c3fe-4c2a-bf7f-55f78233f5e9 for instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 on hv-cinder-82204 Feb 08 17:34:04.672696 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-1e89a51c-ce81-49ee-a273-a26e21d86065 req-b7c5c59b-c0c3-441e-9dbc-3f633cb6dec8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060966 Feb 08 17:34:04.674796 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 368/755] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:04.939103 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-741601b4-a5b7-4f1d-95ab-3b141b64206f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:04.940032 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-741601b4-a5b7-4f1d-95ab-3b141b64206f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:04.947187 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-741601b4-a5b7-4f1d-95ab-3b141b64206f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:04.947653 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-741601b4-a5b7-4f1d-95ab-3b141b64206f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:04.948496 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-741601b4-a5b7-4f1d-95ab-3b141b64206f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:04.949109 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-741601b4-a5b7-4f1d-95ab-3b141b64206f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:05.048669 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-741601b4-a5b7-4f1d-95ab-3b141b64206f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:05.062824 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-741601b4-a5b7-4f1d-95ab-3b141b64206f tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1290 microversion: 2.1 time: 0.129837 Feb 08 17:34:05.063834 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 388/756] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:04 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1290 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:05.219400 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-820ad4e1-dae8-4d97-917b-3ec51ce406ea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:05.220313 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-820ad4e1-dae8-4d97-917b-3ec51ce406ea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:05.230333 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-820ad4e1-dae8-4d97-917b-3ec51ce406ea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:05.231522 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-820ad4e1-dae8-4d97-917b-3ec51ce406ea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:05.232829 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-820ad4e1-dae8-4d97-917b-3ec51ce406ea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:05.233656 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-820ad4e1-dae8-4d97-917b-3ec51ce406ea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:05.459559 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-820ad4e1-dae8-4d97-917b-3ec51ce406ea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:05.474436 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-820ad4e1-dae8-4d97-917b-3ec51ce406ea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:05.477549 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-820ad4e1-dae8-4d97-917b-3ec51ce406ea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:05.479676 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-820ad4e1-dae8-4d97-917b-3ec51ce406ea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.267181 Feb 08 17:34:05.480723 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 369/757] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:05 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:34:06.091568 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8ea4604c-ab58-49e2-a8a8-0481638d9353 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:06.092870 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8ea4604c-ab58-49e2-a8a8-0481638d9353 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:06.105910 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8ea4604c-ab58-49e2-a8a8-0481638d9353 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:06.106677 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8ea4604c-ab58-49e2-a8a8-0481638d9353 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:06.108008 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8ea4604c-ab58-49e2-a8a8-0481638d9353 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:06.110631 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8ea4604c-ab58-49e2-a8a8-0481638d9353 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:06.235091 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8ea4604c-ab58-49e2-a8a8-0481638d9353 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:06.248381 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8ea4604c-ab58-49e2-a8a8-0481638d9353 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1296 microversion: 2.1 time: 0.163964 Feb 08 17:34:06.249797 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 389/758] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:06 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1296 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:06.509518 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-303d7e49-09cd-439f-a614-d1045cbce35d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:06.510609 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-303d7e49-09cd-439f-a614-d1045cbce35d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:06.523812 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-303d7e49-09cd-439f-a614-d1045cbce35d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:06.524600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-303d7e49-09cd-439f-a614-d1045cbce35d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:06.526077 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-303d7e49-09cd-439f-a614-d1045cbce35d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:06.526853 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-303d7e49-09cd-439f-a614-d1045cbce35d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:06.823156 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-303d7e49-09cd-439f-a614-d1045cbce35d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:06.833853 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-303d7e49-09cd-439f-a614-d1045cbce35d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:06.836681 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-303d7e49-09cd-439f-a614-d1045cbce35d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:06.838044 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-303d7e49-09cd-439f-a614-d1045cbce35d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.336336 Feb 08 17:34:06.838961 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 370/759] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:06 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:34:07.278848 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c973ad61-ff29-4254-997e-48b477bc4b44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:07.280989 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c973ad61-ff29-4254-997e-48b477bc4b44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:07.292811 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c973ad61-ff29-4254-997e-48b477bc4b44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:07.293739 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c973ad61-ff29-4254-997e-48b477bc4b44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:07.295047 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c973ad61-ff29-4254-997e-48b477bc4b44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:07.295831 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c973ad61-ff29-4254-997e-48b477bc4b44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:07.515025 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c973ad61-ff29-4254-997e-48b477bc4b44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:07.523085 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c973ad61-ff29-4254-997e-48b477bc4b44 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1362 microversion: 2.1 time: 0.252068 Feb 08 17:34:07.523802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 390/760] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:07 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:07.864158 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4e18a903-e38e-47c9-b310-b746463fbdf3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:07.865190 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4e18a903-e38e-47c9-b310-b746463fbdf3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:07.877534 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4e18a903-e38e-47c9-b310-b746463fbdf3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:07.878364 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4e18a903-e38e-47c9-b310-b746463fbdf3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:07.879812 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4e18a903-e38e-47c9-b310-b746463fbdf3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:07.880659 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4e18a903-e38e-47c9-b310-b746463fbdf3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:08.114767 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4e18a903-e38e-47c9-b310-b746463fbdf3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:08.127773 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4e18a903-e38e-47c9-b310-b746463fbdf3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:08.129621 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4e18a903-e38e-47c9-b310-b746463fbdf3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:08.131058 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4e18a903-e38e-47c9-b310-b746463fbdf3 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.274268 Feb 08 17:34:08.131961 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 371/761] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:07 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:34:08.549851 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-33d5e606-03f0-40f0-b8cc-edfa92779997 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:08.550705 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-33d5e606-03f0-40f0-b8cc-edfa92779997 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:08.561921 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-33d5e606-03f0-40f0-b8cc-edfa92779997 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:08.562658 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-33d5e606-03f0-40f0-b8cc-edfa92779997 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:08.563987 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-33d5e606-03f0-40f0-b8cc-edfa92779997 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:08.564738 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-33d5e606-03f0-40f0-b8cc-edfa92779997 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:08.770310 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-33d5e606-03f0-40f0-b8cc-edfa92779997 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:08.783059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-33d5e606-03f0-40f0-b8cc-edfa92779997 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1362 microversion: 2.1 time: 0.238031 Feb 08 17:34:08.783739 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 391/762] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:08 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:34:09.163698 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-34c4a24f-e50b-455f-bd93-d883530f949f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:09.164860 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-34c4a24f-e50b-455f-bd93-d883530f949f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:09.176781 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-34c4a24f-e50b-455f-bd93-d883530f949f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:09.177621 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-34c4a24f-e50b-455f-bd93-d883530f949f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:09.179025 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-34c4a24f-e50b-455f-bd93-d883530f949f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:09.179787 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-34c4a24f-e50b-455f-bd93-d883530f949f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:09.517799 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-34c4a24f-e50b-455f-bd93-d883530f949f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:09.532424 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-34c4a24f-e50b-455f-bd93-d883530f949f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:09.535541 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-34c4a24f-e50b-455f-bd93-d883530f949f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:09.537730 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-34c4a24f-e50b-455f-bd93-d883530f949f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.381983 Feb 08 17:34:09.538778 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 372/763] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:09 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:34:09.802014 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7365561a-d0a6-40ad-bdbf-4b7503c659e7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:09.802828 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7365561a-d0a6-40ad-bdbf-4b7503c659e7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:09.821308 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7365561a-d0a6-40ad-bdbf-4b7503c659e7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:09.822224 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7365561a-d0a6-40ad-bdbf-4b7503c659e7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:09.823802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7365561a-d0a6-40ad-bdbf-4b7503c659e7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:09.824672 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7365561a-d0a6-40ad-bdbf-4b7503c659e7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:10.059040 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-65ebad31-c2cf-457b-be2a-72cef164011c req-e3ec4297-e6c7-45a7-bf97-930ed1772e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8af1592-80ef-4b09-b8d6-05880da48fae", "tag": "0e5f8222-7e85-4961-a7e7-946aa0f2ff02"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:10.062557 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:34:10.062557 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:34:10.078816 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7365561a-d0a6-40ad-bdbf-4b7503c659e7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:10.096553 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7365561a-d0a6-40ad-bdbf-4b7503c659e7 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1362 microversion: 2.1 time: 0.299228 Feb 08 17:34:10.097638 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 392/764] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:09 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:10.101286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-65ebad31-c2cf-457b-be2a-72cef164011c req-e3ec4297-e6c7-45a7-bf97-930ed1772e59 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:10.109715 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-65ebad31-c2cf-457b-be2a-72cef164011c req-e3ec4297-e6c7-45a7-bf97-930ed1772e59 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:10.131033 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-65ebad31-c2cf-457b-be2a-72cef164011c req-e3ec4297-e6c7-45a7-bf97-930ed1772e59 service nova] Creating event network-changed:0e5f8222-7e85-4961-a7e7-946aa0f2ff02 for instance e8af1592-80ef-4b09-b8d6-05880da48fae on hv-cinder-82204 Feb 08 17:34:10.139341 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-65ebad31-c2cf-457b-be2a-72cef164011c req-e3ec4297-e6c7-45a7-bf97-930ed1772e59 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092895 Feb 08 17:34:10.140342 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 373/765] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:10.574673 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-062612c2-d2b5-4d9e-a23b-e48e44c88ba0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:10.575940 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-062612c2-d2b5-4d9e-a23b-e48e44c88ba0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:10.587866 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-062612c2-d2b5-4d9e-a23b-e48e44c88ba0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:10.587866 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-062612c2-d2b5-4d9e-a23b-e48e44c88ba0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:10.590098 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-062612c2-d2b5-4d9e-a23b-e48e44c88ba0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:10.591388 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-062612c2-d2b5-4d9e-a23b-e48e44c88ba0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:10.844136 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-062612c2-d2b5-4d9e-a23b-e48e44c88ba0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:10.861143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-062612c2-d2b5-4d9e-a23b-e48e44c88ba0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:10.864777 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-062612c2-d2b5-4d9e-a23b-e48e44c88ba0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:10.867080 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-062612c2-d2b5-4d9e-a23b-e48e44c88ba0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1406 microversion: 2.20 time: 0.302766 Feb 08 17:34:10.870462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 393/766] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:10 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:34:11.125582 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3fdc38f3-92eb-4605-9958-a398a73e3efc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:11.126253 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3fdc38f3-92eb-4605-9958-a398a73e3efc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:11.136982 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3fdc38f3-92eb-4605-9958-a398a73e3efc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:11.138211 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3fdc38f3-92eb-4605-9958-a398a73e3efc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:11.139346 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3fdc38f3-92eb-4605-9958-a398a73e3efc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:11.140097 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3fdc38f3-92eb-4605-9958-a398a73e3efc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:11.488100 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-3fdc38f3-92eb-4605-9958-a398a73e3efc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:11.506679 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3fdc38f3-92eb-4605-9958-a398a73e3efc tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1362 microversion: 2.1 time: 0.390416 Feb 08 17:34:11.509533 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 374/767] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:11 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:11.739865 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bd867448-07de-4538-b659-27e2a49bc7fe tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "170b5bbe-a92c-41cf-a58e-03a48d46f308"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:11.741893 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bd867448-07de-4538-b659-27e2a49bc7fe tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:11.752748 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bd867448-07de-4538-b659-27e2a49bc7fe tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:11.753633 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bd867448-07de-4538-b659-27e2a49bc7fe tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:11.755325 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bd867448-07de-4538-b659-27e2a49bc7fe tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:11.756115 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bd867448-07de-4538-b659-27e2a49bc7fe tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:11.899884 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4f5d547d-6f96-4b6c-b0be-55c97a128d0a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:11.900590 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-bd867448-07de-4538-b659-27e2a49bc7fe tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] HTTP exception thrown: Invalid volume: volume 170b5bbe-a92c-41cf-a58e-03a48d46f308 is already attached to instances: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c Feb 08 17:34:11.901297 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4f5d547d-6f96-4b6c-b0be-55c97a128d0a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:11.902274 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bd867448-07de-4538-b659-27e2a49bc7fe tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Returning 400 to user: Invalid volume: volume 170b5bbe-a92c-41cf-a58e-03a48d46f308 is already attached to instances: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:34:11.903911 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bd867448-07de-4538-b659-27e2a49bc7fe tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "POST /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.171375 Feb 08 17:34:11.905019 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 394/768] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:34:11 2022] POST /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments => generated 174 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 08 17:34:11.916208 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4f5d547d-6f96-4b6c-b0be-55c97a128d0a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:11.917356 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4f5d547d-6f96-4b6c-b0be-55c97a128d0a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:11.918760 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4f5d547d-6f96-4b6c-b0be-55c97a128d0a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:11.919791 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4f5d547d-6f96-4b6c-b0be-55c97a128d0a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:12.006231 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-426f29e8-1221-441f-bab7-0edf92ccbab1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:12.007285 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-426f29e8-1221-441f-bab7-0edf92ccbab1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:12.019138 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-426f29e8-1221-441f-bab7-0edf92ccbab1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:12.020073 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-426f29e8-1221-441f-bab7-0edf92ccbab1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:12.021626 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-426f29e8-1221-441f-bab7-0edf92ccbab1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:12.022501 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-426f29e8-1221-441f-bab7-0edf92ccbab1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:12.162132 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-426f29e8-1221-441f-bab7-0edf92ccbab1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lazy-loading 'services' on Instance uuid 73830e35-4e4d-4ca1-a5db-75fe7400fc4c {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:34:12.163553 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4f5d547d-6f96-4b6c-b0be-55c97a128d0a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:12.177736 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4f5d547d-6f96-4b6c-b0be-55c97a128d0a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:12.180656 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4f5d547d-6f96-4b6c-b0be-55c97a128d0a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:12.182851 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4f5d547d-6f96-4b6c-b0be-55c97a128d0a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1598 microversion: 2.20 time: 0.289523 Feb 08 17:34:12.184944 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 375/769] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:11 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1598 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:34:12.215195 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8d956e83-12f8-4279-884d-e5aec1577417 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:12.216028 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8d956e83-12f8-4279-884d-e5aec1577417 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:12.225212 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d956e83-12f8-4279-884d-e5aec1577417 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:12.225755 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d956e83-12f8-4279-884d-e5aec1577417 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:12.226627 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d956e83-12f8-4279-884d-e5aec1577417 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:12.227128 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d956e83-12f8-4279-884d-e5aec1577417 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:12.284184 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-426f29e8-1221-441f-bab7-0edf92ccbab1 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "DELETE /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments/170b5bbe-a92c-41cf-a58e-03a48d46f308" status: 202 len: 0 microversion: 2.1 time: 0.284823 Feb 08 17:34:12.285909 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 395/770] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:34:11 2022] DELETE /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments/170b5bbe-a92c-41cf-a58e-03a48d46f308 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 17:34:12.301953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-82850703-d52c-4f8b-a454-838c3569987f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:12.304161 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-82850703-d52c-4f8b-a454-838c3569987f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:12.316392 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82850703-d52c-4f8b-a454-838c3569987f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:12.317421 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82850703-d52c-4f8b-a454-838c3569987f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:12.319815 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82850703-d52c-4f8b-a454-838c3569987f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:12.321050 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82850703-d52c-4f8b-a454-838c3569987f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:12.370164 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-82850703-d52c-4f8b-a454-838c3569987f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077313 Feb 08 17:34:12.371432 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 396/771] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:34:12 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:34:12.386214 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8d956e83-12f8-4279-884d-e5aec1577417 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.175204 Feb 08 17:34:12.387071 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 376/772] 10.222.0.69 () {60 vars in 1315 bytes} [Tue Feb 8 17:34:12 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 17:34:12.537606 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e18ce2f6-be78-412c-8a42-e889dd8523f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:12.538740 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e18ce2f6-be78-412c-8a42-e889dd8523f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:12.551166 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e18ce2f6-be78-412c-8a42-e889dd8523f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:12.552385 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e18ce2f6-be78-412c-8a42-e889dd8523f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:12.554053 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e18ce2f6-be78-412c-8a42-e889dd8523f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:12.555162 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e18ce2f6-be78-412c-8a42-e889dd8523f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:13.116352 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e18ce2f6-be78-412c-8a42-e889dd8523f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:13.130729 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e18ce2f6-be78-412c-8a42-e889dd8523f3 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1362 microversion: 2.1 time: 0.601376 Feb 08 17:34:13.132188 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 397/773] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:12 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1362 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:34:13.390408 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6df273ec-c982-4ef9-99b1-8becb814fa84 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:13.393259 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6df273ec-c982-4ef9-99b1-8becb814fa84 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:13.404259 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6df273ec-c982-4ef9-99b1-8becb814fa84 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:13.405193 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6df273ec-c982-4ef9-99b1-8becb814fa84 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:13.406863 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6df273ec-c982-4ef9-99b1-8becb814fa84 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:13.407816 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6df273ec-c982-4ef9-99b1-8becb814fa84 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:13.466569 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6df273ec-c982-4ef9-99b1-8becb814fa84 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084450 Feb 08 17:34:13.467613 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 377/774] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:34:13 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:14.155860 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4a745f37-9691-4ce0-bbf5-e23d37439307 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:14.157120 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4a745f37-9691-4ce0-bbf5-e23d37439307 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:14.162965 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4a745f37-9691-4ce0-bbf5-e23d37439307 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:14.163417 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4a745f37-9691-4ce0-bbf5-e23d37439307 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:14.164408 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4a745f37-9691-4ce0-bbf5-e23d37439307 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:14.165508 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4a745f37-9691-4ce0-bbf5-e23d37439307 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:14.419689 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4a745f37-9691-4ce0-bbf5-e23d37439307 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:14.437492 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4a745f37-9691-4ce0-bbf5-e23d37439307 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1362 microversion: 2.1 time: 0.285689 Feb 08 17:34:14.438970 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 398/775] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:14 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:14.489536 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3fb17d63-df9a-4764-b58c-79157f3373c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:14.489536 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3fb17d63-df9a-4764-b58c-79157f3373c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:14.497877 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9e6c0361-b43c-41cc-9327-2def5f262833 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:14.498977 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9e6c0361-b43c-41cc-9327-2def5f262833 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:14.501298 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3fb17d63-df9a-4764-b58c-79157f3373c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:14.502516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3fb17d63-df9a-4764-b58c-79157f3373c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:14.504167 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3fb17d63-df9a-4764-b58c-79157f3373c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:14.505082 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3fb17d63-df9a-4764-b58c-79157f3373c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:14.509383 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9e6c0361-b43c-41cc-9327-2def5f262833 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:14.510160 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9e6c0361-b43c-41cc-9327-2def5f262833 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:14.512102 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9e6c0361-b43c-41cc-9327-2def5f262833 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:14.513124 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9e6c0361-b43c-41cc-9327-2def5f262833 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:14.556350 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3fb17d63-df9a-4764-b58c-79157f3373c9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077765 Feb 08 17:34:14.557461 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 378/776] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:34:14 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 17:34:14.567367 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-bd16328e-a4b9-44b7-b33a-f77b4e5bd59f req-2622ee8f-2be4-49cf-a6fe-f86ef0925e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9897ad7c-5c82-4c2d-ad35-d99660e7a347", "tag": "a4c518af-c3fe-4c2a-bf7f-55f78233f5e9"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:14.569847 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:34:14.569847 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:34:14.582725 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-bd16328e-a4b9-44b7-b33a-f77b4e5bd59f req-2622ee8f-2be4-49cf-a6fe-f86ef0925e2a service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:14.583551 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-bd16328e-a4b9-44b7-b33a-f77b4e5bd59f req-2622ee8f-2be4-49cf-a6fe-f86ef0925e2a service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:14.606301 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-bd16328e-a4b9-44b7-b33a-f77b4e5bd59f req-2622ee8f-2be4-49cf-a6fe-f86ef0925e2a service nova] Creating event network-changed:a4c518af-c3fe-4c2a-bf7f-55f78233f5e9 for instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 on hv-cinder-82204 Feb 08 17:34:14.616028 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-bd16328e-a4b9-44b7-b33a-f77b4e5bd59f req-2622ee8f-2be4-49cf-a6fe-f86ef0925e2a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054051 Feb 08 17:34:14.617132 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 379/777] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:14.750516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1905915377", "imageRef": "54ee5452-a301-4f95-956d-fe9f644c20d5", "flavorRef": "452", "networks": [{"uuid": "68303811-987d-45d3-911c-ea578153745e"}]}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:14.796408 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9e6c0361-b43c-41cc-9327-2def5f262833 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:14.813644 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9e6c0361-b43c-41cc-9327-2def5f262833 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:14.816299 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9e6c0361-b43c-41cc-9327-2def5f262833 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:14.819170 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9e6c0361-b43c-41cc-9327-2def5f262833 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1598 microversion: 2.20 time: 0.327847 Feb 08 17:34:14.820943 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 399/778] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:14 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1598 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:34:14.854528 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.network.neutron [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] validate_networks() for [('68303811-987d-45d3-911c-ea578153745e', None, None, None, None, None)] {{(pid=116479) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:34:14.902944 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-92b37560-e038-4395-b372-6b654257be52 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:14.904475 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-92b37560-e038-4395-b372-6b654257be52 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:14.917324 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-92b37560-e038-4395-b372-6b654257be52 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:14.918568 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-92b37560-e038-4395-b372-6b654257be52 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:14.920211 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-92b37560-e038-4395-b372-6b654257be52 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:14.921222 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-92b37560-e038-4395-b372-6b654257be52 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:15.089454 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-92b37560-e038-4395-b372-6b654257be52 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lazy-loading 'services' on Instance uuid 538dbde7-2cb0-44ca-9f40-203e7a7764a3 {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:34:15.234890 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-92b37560-e038-4395-b372-6b654257be52 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "DELETE /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3/os-volume_attachments/9a0a14bb-e07d-4ff9-a502-08fa5eb4db4d" status: 202 len: 0 microversion: 2.1 time: 0.338400 Feb 08 17:34:15.236311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 400/779] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:34:14 2022] DELETE /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3/os-volume_attachments/9a0a14bb-e07d-4ff9-a502-08fa5eb4db4d => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:34:15.464858 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a39c2321-4395-4435-bb10-81acc8e8a295 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:15.466558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a39c2321-4395-4435-bb10-81acc8e8a295 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:15.484319 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a39c2321-4395-4435-bb10-81acc8e8a295 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:15.485982 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a39c2321-4395-4435-bb10-81acc8e8a295 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:15.489499 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a39c2321-4395-4435-bb10-81acc8e8a295 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:15.490831 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a39c2321-4395-4435-bb10-81acc8e8a295 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:15.794295 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a39c2321-4395-4435-bb10-81acc8e8a295 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:15.820063 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a39c2321-4395-4435-bb10-81acc8e8a295 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1362 microversion: 2.1 time: 0.364034 Feb 08 17:34:15.821104 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 401/780] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:15 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:34:15.855635 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-256e8324-6c45-4e9d-aaed-0c7794f61794 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:15.856570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-256e8324-6c45-4e9d-aaed-0c7794f61794 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:15.873766 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-256e8324-6c45-4e9d-aaed-0c7794f61794 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:15.874949 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-256e8324-6c45-4e9d-aaed-0c7794f61794 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:15.878747 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-256e8324-6c45-4e9d-aaed-0c7794f61794 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:15.879880 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-256e8324-6c45-4e9d-aaed-0c7794f61794 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:16.000259 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Flavor limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:34:16.001145 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Image limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:34:16.002142 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Flavor pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:34:16.002885 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Image pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:34:16.003633 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:34:16.038043 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:16.039480 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:16.041088 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:16.041997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:16.084168 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Getting quotas for project 74eb713ad3e34829a512ab7b068613e4. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:34:16.095137 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Getting quotas for user 4ecb87afe54d4389b8177a3570088e67 and project 74eb713ad3e34829a512ab7b068613e4. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:34:16.146892 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Going to run 1 instances... {{(pid=116479) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:34:16.152610 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54ee5452-a301-4f95-956d-fe9f644c20d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:34:16.222827 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-256e8324-6c45-4e9d-aaed-0c7794f61794 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:16.244710 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-256e8324-6c45-4e9d-aaed-0c7794f61794 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:16.248224 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-256e8324-6c45-4e9d-aaed-0c7794f61794 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:16.250812 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-256e8324-6c45-4e9d-aaed-0c7794f61794 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1598 microversion: 2.20 time: 0.403144 Feb 08 17:34:16.275434 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 402/781] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:15 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1598 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:34:16.293330 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1c92fefe-eebf-453a-b982-5d87e1cc3ec2 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549667 Feb 08 17:34:16.295837 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 380/782] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:34:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 08 17:34:16.313137 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5c2eda0b-7efd-4e59-a893-0baa295525be tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:16.314270 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5c2eda0b-7efd-4e59-a893-0baa295525be tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:16.434919 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5c2eda0b-7efd-4e59-a893-0baa295525be tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:16.452602 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5c2eda0b-7efd-4e59-a893-0baa295525be tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1218 microversion: 2.1 time: 0.146872 Feb 08 17:34:16.454270 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 403/783] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:16 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1218 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:16.849234 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1e5589c6-9ae9-44f3-8665-54e7c21fa3a8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:16.850262 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1e5589c6-9ae9-44f3-8665-54e7c21fa3a8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:16.859762 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1e5589c6-9ae9-44f3-8665-54e7c21fa3a8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:16.860973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1e5589c6-9ae9-44f3-8665-54e7c21fa3a8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:16.862902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1e5589c6-9ae9-44f3-8665-54e7c21fa3a8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:16.863980 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1e5589c6-9ae9-44f3-8665-54e7c21fa3a8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:17.241642 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1e5589c6-9ae9-44f3-8665-54e7c21fa3a8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:17.255252 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1e5589c6-9ae9-44f3-8665-54e7c21fa3a8 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1362 microversion: 2.1 time: 0.413247 Feb 08 17:34:17.256245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 381/784] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:16 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:17.285268 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6f10734f-b2b9-4828-b0bd-c5ead0b177bc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:17.286383 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6f10734f-b2b9-4828-b0bd-c5ead0b177bc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:17.298581 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f10734f-b2b9-4828-b0bd-c5ead0b177bc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:17.299386 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f10734f-b2b9-4828-b0bd-c5ead0b177bc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:17.300922 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f10734f-b2b9-4828-b0bd-c5ead0b177bc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:17.301721 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6f10734f-b2b9-4828-b0bd-c5ead0b177bc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:17.491207 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6704ff0d-7134-47ec-adfc-86c76622aaf7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:17.493521 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6704ff0d-7134-47ec-adfc-86c76622aaf7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:17.516834 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6704ff0d-7134-47ec-adfc-86c76622aaf7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:17.517781 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6704ff0d-7134-47ec-adfc-86c76622aaf7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:17.520178 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6704ff0d-7134-47ec-adfc-86c76622aaf7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:17.520914 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6704ff0d-7134-47ec-adfc-86c76622aaf7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:17.544194 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6f10734f-b2b9-4828-b0bd-c5ead0b177bc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:17.558760 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6f10734f-b2b9-4828-b0bd-c5ead0b177bc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:17.561699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6f10734f-b2b9-4828-b0bd-c5ead0b177bc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:17.564117 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6f10734f-b2b9-4828-b0bd-c5ead0b177bc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1715 microversion: 2.20 time: 0.284201 Feb 08 17:34:17.565113 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 404/785] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:34:17 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1715 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:34:17.600746 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fb22a04f-a47f-4633-a486-1bc7ceb31f1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:17.602392 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-fb22a04f-a47f-4633-a486-1bc7ceb31f1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:17.616724 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fb22a04f-a47f-4633-a486-1bc7ceb31f1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:17.617552 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fb22a04f-a47f-4633-a486-1bc7ceb31f1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:17.620419 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fb22a04f-a47f-4633-a486-1bc7ceb31f1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:17.621244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fb22a04f-a47f-4633-a486-1bc7ceb31f1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:17.669258 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6704ff0d-7134-47ec-adfc-86c76622aaf7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:17.679576 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-fb22a04f-a47f-4633-a486-1bc7ceb31f1f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/ips" status: 200 len: 150 microversion: 2.20 time: 0.091584 Feb 08 17:34:17.681772 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 405/786] 10.222.0.69 () {60 vars in 1288 bytes} [Tue Feb 8 17:34:17 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/ips => generated 150 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 17:34:17.684070 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6704ff0d-7134-47ec-adfc-86c76622aaf7 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1270 microversion: 2.1 time: 0.200628 Feb 08 17:34:17.685297 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 382/787] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:17 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:34:17.695355 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-aaf42027-5690-439b-8c4d-242bbd7d967e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:17.696322 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-aaf42027-5690-439b-8c4d-242bbd7d967e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:17.710864 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aaf42027-5690-439b-8c4d-242bbd7d967e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:17.711718 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aaf42027-5690-439b-8c4d-242bbd7d967e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:17.713259 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aaf42027-5690-439b-8c4d-242bbd7d967e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:17.714565 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-aaf42027-5690-439b-8c4d-242bbd7d967e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:17.766265 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-aaf42027-5690-439b-8c4d-242bbd7d967e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:34:17.933826 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-aaf42027-5690-439b-8c4d-242bbd7d967e tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "DELETE /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 204 len: 0 microversion: 2.1 time: 0.248913 Feb 08 17:34:17.934775 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 406/788] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:34:17 2022] DELETE /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:34:17.949379 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-095f4315-135a-4c48-a45d-633e5d1c3725 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:17.950685 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-095f4315-135a-4c48-a45d-633e5d1c3725 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:17.962587 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-095f4315-135a-4c48-a45d-633e5d1c3725 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:17.963293 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-095f4315-135a-4c48-a45d-633e5d1c3725 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:17.964673 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-095f4315-135a-4c48-a45d-633e5d1c3725 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:17.965488 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-095f4315-135a-4c48-a45d-633e5d1c3725 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:18.276627 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-095f4315-135a-4c48-a45d-633e5d1c3725 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:18.284820 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bf06112d-8f04-4cad-b13d-929c45bc6ce2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:18.286138 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bf06112d-8f04-4cad-b13d-929c45bc6ce2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:18.291839 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-095f4315-135a-4c48-a45d-633e5d1c3725 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1514 microversion: 2.1 time: 0.348906 Feb 08 17:34:18.302448 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 383/789] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:17 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1514 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:34:18.310854 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf06112d-8f04-4cad-b13d-929c45bc6ce2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:18.313205 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf06112d-8f04-4cad-b13d-929c45bc6ce2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:18.314285 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf06112d-8f04-4cad-b13d-929c45bc6ce2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:18.314914 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bf06112d-8f04-4cad-b13d-929c45bc6ce2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:18.415109 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-0f0d318b-477d-49df-a8e0-6766e91f9e81 req-8cb219ae-820b-48f9-a9aa-5f7cb0c71326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8af1592-80ef-4b09-b8d6-05880da48fae", "name": "network-vif-plugged", "status": "completed", "tag": "0e5f8222-7e85-4961-a7e7-946aa0f2ff02"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:18.418015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:34:18.418015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:34:18.429583 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-0f0d318b-477d-49df-a8e0-6766e91f9e81 req-8cb219ae-820b-48f9-a9aa-5f7cb0c71326 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:18.430302 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-0f0d318b-477d-49df-a8e0-6766e91f9e81 req-8cb219ae-820b-48f9-a9aa-5f7cb0c71326 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:18.455492 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-0f0d318b-477d-49df-a8e0-6766e91f9e81 req-8cb219ae-820b-48f9-a9aa-5f7cb0c71326 service nova] Creating event network-vif-plugged:0e5f8222-7e85-4961-a7e7-946aa0f2ff02 for instance e8af1592-80ef-4b09-b8d6-05880da48fae on hv-cinder-82204 Feb 08 17:34:18.467116 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-0f0d318b-477d-49df-a8e0-6766e91f9e81 req-8cb219ae-820b-48f9-a9aa-5f7cb0c71326 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054962 Feb 08 17:34:18.473834 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 384/790] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:34:18.685984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bf06112d-8f04-4cad-b13d-929c45bc6ce2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:18.702740 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bf06112d-8f04-4cad-b13d-929c45bc6ce2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1362 microversion: 2.1 time: 0.425096 Feb 08 17:34:18.707186 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 407/791] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:18 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1362 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:34:18.734514 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a8118693-4c6f-4c6f-8490-8ad826ac7e9e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:18.736341 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a8118693-4c6f-4c6f-8490-8ad826ac7e9e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:18.750485 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a8118693-4c6f-4c6f-8490-8ad826ac7e9e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:18.751830 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a8118693-4c6f-4c6f-8490-8ad826ac7e9e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:18.753754 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a8118693-4c6f-4c6f-8490-8ad826ac7e9e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:18.754749 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a8118693-4c6f-4c6f-8490-8ad826ac7e9e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:18.973865 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a8118693-4c6f-4c6f-8490-8ad826ac7e9e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:18.985684 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a8118693-4c6f-4c6f-8490-8ad826ac7e9e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1288 microversion: 2.1 time: 0.263952 Feb 08 17:34:18.986463 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 385/792] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:18 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1288 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:34:19.321086 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-49512c13-e89b-4f09-98f4-efab093e4a6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:19.323594 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-49512c13-e89b-4f09-98f4-efab093e4a6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:19.350101 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-49512c13-e89b-4f09-98f4-efab093e4a6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:19.350555 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-49512c13-e89b-4f09-98f4-efab093e4a6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:19.352437 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-49512c13-e89b-4f09-98f4-efab093e4a6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:19.353251 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-49512c13-e89b-4f09-98f4-efab093e4a6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:19.613052 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-49512c13-e89b-4f09-98f4-efab093e4a6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:19.625091 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-49512c13-e89b-4f09-98f4-efab093e4a6a tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1514 microversion: 2.1 time: 0.310902 Feb 08 17:34:19.625988 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 408/793] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:19 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1514 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:19.736450 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2276d578-6c82-4d69-9ea9-e373e0cd8ddb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:19.737432 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2276d578-6c82-4d69-9ea9-e373e0cd8ddb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:19.748176 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2276d578-6c82-4d69-9ea9-e373e0cd8ddb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:19.748886 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2276d578-6c82-4d69-9ea9-e373e0cd8ddb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:19.750807 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2276d578-6c82-4d69-9ea9-e373e0cd8ddb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:19.751575 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2276d578-6c82-4d69-9ea9-e373e0cd8ddb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:20.025944 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b9a37953-df3e-4843-83a0-50a9f1d11143 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:20.026659 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-b9a37953-df3e-4843-83a0-50a9f1d11143 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:20.044033 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b9a37953-df3e-4843-83a0-50a9f1d11143 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:20.045198 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b9a37953-df3e-4843-83a0-50a9f1d11143 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:20.046736 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b9a37953-df3e-4843-83a0-50a9f1d11143 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:20.047570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b9a37953-df3e-4843-83a0-50a9f1d11143 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:20.141783 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2276d578-6c82-4d69-9ea9-e373e0cd8ddb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:20.160207 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2276d578-6c82-4d69-9ea9-e373e0cd8ddb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1362 microversion: 2.1 time: 0.426459 Feb 08 17:34:20.160207 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 386/794] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:19 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:20.342441 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b9a37953-df3e-4843-83a0-50a9f1d11143 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:20.357271 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b9a37953-df3e-4843-83a0-50a9f1d11143 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.349470 Feb 08 17:34:20.358749 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 409/795] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:20 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:34:20.655319 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e1d04bab-3c06-43f7-b553-eaf84b11c503 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:20.655969 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-e1d04bab-3c06-43f7-b553-eaf84b11c503 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:20.673595 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1d04bab-3c06-43f7-b553-eaf84b11c503 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:20.674472 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1d04bab-3c06-43f7-b553-eaf84b11c503 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:20.675975 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1d04bab-3c06-43f7-b553-eaf84b11c503 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:20.676791 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e1d04bab-3c06-43f7-b553-eaf84b11c503 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:21.079245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e1d04bab-3c06-43f7-b553-eaf84b11c503 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:21.093478 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e1d04bab-3c06-43f7-b553-eaf84b11c503 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1514 microversion: 2.1 time: 0.444741 Feb 08 17:34:21.094520 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 387/796] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:20 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1514 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:21.187209 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d749cbf4-57c4-42f0-9254-b5074416e2ce tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:21.188322 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d749cbf4-57c4-42f0-9254-b5074416e2ce tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:21.197530 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d749cbf4-57c4-42f0-9254-b5074416e2ce tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:21.198248 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d749cbf4-57c4-42f0-9254-b5074416e2ce tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:21.199698 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d749cbf4-57c4-42f0-9254-b5074416e2ce tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:21.200490 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d749cbf4-57c4-42f0-9254-b5074416e2ce tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:21.396141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d02721a2-3a42-4c54-a9c5-3ecd9db820ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:21.397042 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d02721a2-3a42-4c54-a9c5-3ecd9db820ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:21.407357 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d02721a2-3a42-4c54-a9c5-3ecd9db820ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:21.407948 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d02721a2-3a42-4c54-a9c5-3ecd9db820ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:21.409278 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d02721a2-3a42-4c54-a9c5-3ecd9db820ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:21.410090 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d02721a2-3a42-4c54-a9c5-3ecd9db820ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:21.468038 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d749cbf4-57c4-42f0-9254-b5074416e2ce tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:21.501275 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d749cbf4-57c4-42f0-9254-b5074416e2ce tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1362 microversion: 2.1 time: 0.319772 Feb 08 17:34:21.503518 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 410/797] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:21 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:21.512596 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-641fc619-29b8-4525-a1aa-021cd78742b1 req-191af4b5-8327-422b-9b21-fbb7d4ead881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39b3cf2-49f7-4975-95ef-116f071d7040", "tag": "0c3ed2a4-e2ce-42dc-95fa-e4ce5541a2f6"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:21.516166 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:34:21.516166 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:34:21.532057 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-641fc619-29b8-4525-a1aa-021cd78742b1 req-191af4b5-8327-422b-9b21-fbb7d4ead881 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:21.532753 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-641fc619-29b8-4525-a1aa-021cd78742b1 req-191af4b5-8327-422b-9b21-fbb7d4ead881 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:21.556174 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-641fc619-29b8-4525-a1aa-021cd78742b1 req-191af4b5-8327-422b-9b21-fbb7d4ead881 service nova] Creating event network-changed:0c3ed2a4-e2ce-42dc-95fa-e4ce5541a2f6 for instance b39b3cf2-49f7-4975-95ef-116f071d7040 on hv-cinder-82204 Feb 08 17:34:21.566354 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-641fc619-29b8-4525-a1aa-021cd78742b1 req-191af4b5-8327-422b-9b21-fbb7d4ead881 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060594 Feb 08 17:34:21.567499 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 411/798] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:21.873040 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d02721a2-3a42-4c54-a9c5-3ecd9db820ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:21.885115 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d02721a2-3a42-4c54-a9c5-3ecd9db820ee tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.495919 Feb 08 17:34:21.886770 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 388/799] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:21 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:22.125019 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d77e9673-7d27-43c6-bdf2-1204a2777cc5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:22.126405 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d77e9673-7d27-43c6-bdf2-1204a2777cc5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:22.138212 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d77e9673-7d27-43c6-bdf2-1204a2777cc5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:22.139199 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d77e9673-7d27-43c6-bdf2-1204a2777cc5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:22.140902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d77e9673-7d27-43c6-bdf2-1204a2777cc5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:22.142596 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d77e9673-7d27-43c6-bdf2-1204a2777cc5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:22.425514 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d77e9673-7d27-43c6-bdf2-1204a2777cc5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:22.449870 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d77e9673-7d27-43c6-bdf2-1204a2777cc5 tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1514 microversion: 2.1 time: 0.333261 Feb 08 17:34:22.450904 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 412/800] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:22 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1514 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:22.532708 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-70a46d53-425f-4b96-b633-040eae5d5f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:22.533874 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-70a46d53-425f-4b96-b633-040eae5d5f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:22.546117 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-70a46d53-425f-4b96-b633-040eae5d5f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:22.547181 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-70a46d53-425f-4b96-b633-040eae5d5f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:22.548711 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-70a46d53-425f-4b96-b633-040eae5d5f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:22.549724 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-70a46d53-425f-4b96-b633-040eae5d5f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:22.924534 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-648aa0c6-db53-4b9f-a7bb-c27eedda1465 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:22.926011 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-648aa0c6-db53-4b9f-a7bb-c27eedda1465 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:22.937952 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-648aa0c6-db53-4b9f-a7bb-c27eedda1465 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:22.938691 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-648aa0c6-db53-4b9f-a7bb-c27eedda1465 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:22.940443 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-648aa0c6-db53-4b9f-a7bb-c27eedda1465 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:22.941263 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-648aa0c6-db53-4b9f-a7bb-c27eedda1465 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:22.945858 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-70a46d53-425f-4b96-b633-040eae5d5f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:22.969441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-70a46d53-425f-4b96-b633-040eae5d5f3a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1547 microversion: 2.1 time: 0.440519 Feb 08 17:34:22.981749 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 389/801] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:22 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1547 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:23.000715 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cc65e13c-c701-4b18-a2fd-966301686c38 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:23.001592 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-cc65e13c-c701-4b18-a2fd-966301686c38 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:23.018938 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cc65e13c-c701-4b18-a2fd-966301686c38 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:23.019754 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cc65e13c-c701-4b18-a2fd-966301686c38 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:23.021249 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cc65e13c-c701-4b18-a2fd-966301686c38 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:23.022060 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cc65e13c-c701-4b18-a2fd-966301686c38 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:23.210278 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-648aa0c6-db53-4b9f-a7bb-c27eedda1465 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:23.226555 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-648aa0c6-db53-4b9f-a7bb-c27eedda1465 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.308681 Feb 08 17:34:23.227650 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 413/802] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:22 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:34:23.301782 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cc65e13c-c701-4b18-a2fd-966301686c38 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.307665 Feb 08 17:34:23.302584 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 390/803] 10.222.0.69 () {58 vars in 1274 bytes} [Tue Feb 8 17:34:22 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-interface => generated 284 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:34:23.483419 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-19900404-1c50-4c53-a822-085356db587f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:23.485081 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-19900404-1c50-4c53-a822-085356db587f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:23.498047 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-19900404-1c50-4c53-a822-085356db587f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:23.499183 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-19900404-1c50-4c53-a822-085356db587f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:23.501745 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-19900404-1c50-4c53-a822-085356db587f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:23.502424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-19900404-1c50-4c53-a822-085356db587f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:24.224144 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-19900404-1c50-4c53-a822-085356db587f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:24.242137 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-19900404-1c50-4c53-a822-085356db587f tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1514 microversion: 2.1 time: 0.769515 Feb 08 17:34:24.243465 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 414/804] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:23 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1514 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:24.272794 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-37d61f50-d306-4a28-a454-4f118537d374 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:24.274887 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-37d61f50-d306-4a28-a454-4f118537d374 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:24.289529 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37d61f50-d306-4a28-a454-4f118537d374 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:24.291097 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37d61f50-d306-4a28-a454-4f118537d374 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:24.293242 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37d61f50-d306-4a28-a454-4f118537d374 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:24.294520 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37d61f50-d306-4a28-a454-4f118537d374 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:24.696465 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-37d61f50-d306-4a28-a454-4f118537d374 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:24.708481 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-37d61f50-d306-4a28-a454-4f118537d374 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.449959 Feb 08 17:34:24.725198 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 391/805] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:24 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:24.919073 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-96809b02-f6b6-4fcd-a8d5-55a5018a6dbc req-757adff5-36ea-4bc4-9154-0fd893602ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "538dbde7-2cb0-44ca-9f40-203e7a7764a3", "name": "network-vif-deleted", "tag": "2ce2fd96-10b4-41ed-951a-837a866ac88e"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:24.922846 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:34:24.922846 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:34:24.940649 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-96809b02-f6b6-4fcd-a8d5-55a5018a6dbc req-757adff5-36ea-4bc4-9154-0fd893602ab6 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:24.941507 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-96809b02-f6b6-4fcd-a8d5-55a5018a6dbc req-757adff5-36ea-4bc4-9154-0fd893602ab6 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:24.969573 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-96809b02-f6b6-4fcd-a8d5-55a5018a6dbc req-757adff5-36ea-4bc4-9154-0fd893602ab6 service nova] Creating event network-vif-deleted:2ce2fd96-10b4-41ed-951a-837a866ac88e for instance 538dbde7-2cb0-44ca-9f40-203e7a7764a3 on hv-cinder-82204 Feb 08 17:34:24.978257 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-96809b02-f6b6-4fcd-a8d5-55a5018a6dbc req-757adff5-36ea-4bc4-9154-0fd893602ab6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067759 Feb 08 17:34:24.981732 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 415/806] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:25.271050 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-084efc08-9b4b-4e8e-9e22-bad72a37b1fc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:25.272341 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-084efc08-9b4b-4e8e-9e22-bad72a37b1fc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:25.285777 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-084efc08-9b4b-4e8e-9e22-bad72a37b1fc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:25.286726 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-084efc08-9b4b-4e8e-9e22-bad72a37b1fc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:25.288270 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-084efc08-9b4b-4e8e-9e22-bad72a37b1fc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:25.289404 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-084efc08-9b4b-4e8e-9e22-bad72a37b1fc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:25.339040 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-886011af-8238-4c02-9aa4-49f26be68f48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:25.340321 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-886011af-8238-4c02-9aa4-49f26be68f48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:25.357361 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-886011af-8238-4c02-9aa4-49f26be68f48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:25.358821 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-886011af-8238-4c02-9aa4-49f26be68f48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:25.359591 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-886011af-8238-4c02-9aa4-49f26be68f48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:25.360419 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-886011af-8238-4c02-9aa4-49f26be68f48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:25.366124 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-084efc08-9b4b-4e8e-9e22-bad72a37b1fc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:25.367046 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-084efc08-9b4b-4e8e-9e22-bad72a37b1fc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:25.367932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-084efc08-9b4b-4e8e-9e22-bad72a37b1fc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lazy-loading 'fault' on Instance uuid 538dbde7-2cb0-44ca-9f40-203e7a7764a3 {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:34:25.442519 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-084efc08-9b4b-4e8e-9e22-bad72a37b1fc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f7c4ae54ed48e8964818e2cc18bc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc58680f1494f0c941c254f20b7ad9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:25.459865 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-084efc08-9b4b-4e8e-9e22-bad72a37b1fc tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 200 len: 1309 microversion: 2.1 time: 0.195008 Feb 08 17:34:25.461070 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 392/807] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:25 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 1309 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:25.589312 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-92ccc776-486c-4c62-9992-a3da6d5bb803 req-0cb8de45-54c1-49f8-98b2-96c74c05ef3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8af1592-80ef-4b09-b8d6-05880da48fae", "tag": "0e5f8222-7e85-4961-a7e7-946aa0f2ff02"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:25.589312 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:34:25.589312 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:34:25.603305 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-92ccc776-486c-4c62-9992-a3da6d5bb803 req-0cb8de45-54c1-49f8-98b2-96c74c05ef3c service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:25.603639 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-92ccc776-486c-4c62-9992-a3da6d5bb803 req-0cb8de45-54c1-49f8-98b2-96c74c05ef3c service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:25.631476 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-92ccc776-486c-4c62-9992-a3da6d5bb803 req-0cb8de45-54c1-49f8-98b2-96c74c05ef3c service nova] Creating event network-changed:0e5f8222-7e85-4961-a7e7-946aa0f2ff02 for instance e8af1592-80ef-4b09-b8d6-05880da48fae on hv-cinder-82204 Feb 08 17:34:25.642062 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-92ccc776-486c-4c62-9992-a3da6d5bb803 req-0cb8de45-54c1-49f8-98b2-96c74c05ef3c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178200 Feb 08 17:34:25.643151 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 393/808] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:25.701862 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-886011af-8238-4c02-9aa4-49f26be68f48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:25.719061 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-886011af-8238-4c02-9aa4-49f26be68f48 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1547 microversion: 2.1 time: 0.388329 Feb 08 17:34:25.719754 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 416/809] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:25 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1547 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:25.748718 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-02f1d398-604d-4989-8cc6-185bc5b8b383 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:25.749751 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-02f1d398-604d-4989-8cc6-185bc5b8b383 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:25.775997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02f1d398-604d-4989-8cc6-185bc5b8b383 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:25.776691 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02f1d398-604d-4989-8cc6-185bc5b8b383 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:25.778087 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02f1d398-604d-4989-8cc6-185bc5b8b383 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:25.778855 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02f1d398-604d-4989-8cc6-185bc5b8b383 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:26.298193 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-02f1d398-604d-4989-8cc6-185bc5b8b383 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:26.316939 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-02f1d398-604d-4989-8cc6-185bc5b8b383 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.582584 Feb 08 17:34:26.318058 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 394/810] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:25 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:26.488959 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2f88ae26-67f7-4d07-9f63-adff58ad210d tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:26.490383 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2f88ae26-67f7-4d07-9f63-adff58ad210d tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] [instance: 538dbde7-2cb0-44ca-9f40-203e7a7764a3] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:26.507739 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f88ae26-67f7-4d07-9f63-adff58ad210d tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:26.508833 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f88ae26-67f7-4d07-9f63-adff58ad210d tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:26.511127 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f88ae26-67f7-4d07-9f63-adff58ad210d tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:26.511771 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2f88ae26-67f7-4d07-9f63-adff58ad210d tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:26.546366 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-2f88ae26-67f7-4d07-9f63-adff58ad210d tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] HTTP exception thrown: Instance 538dbde7-2cb0-44ca-9f40-203e7a7764a3 could not be found. Feb 08 17:34:26.547611 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2f88ae26-67f7-4d07-9f63-adff58ad210d tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] Returning 404 to user: Instance 538dbde7-2cb0-44ca-9f40-203e7a7764a3 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:34:26.549564 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2f88ae26-67f7-4d07-9f63-adff58ad210d tempest-VolumesSnapshotTestJSON-1942015834 tempest-VolumesSnapshotTestJSON-1942015834-project] 10.222.0.69 "GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3" status: 404 len: 111 microversion: 2.1 time: 0.070095 Feb 08 17:34:26.550563 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 417/811] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:26 2022] GET /compute/v2.1/servers/538dbde7-2cb0-44ca-9f40-203e7a7764a3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:34:26.766728 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b37635cd-990a-4715-adf6-eb6de298e07b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:26.769676 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b37635cd-990a-4715-adf6-eb6de298e07b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:26.786634 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b37635cd-990a-4715-adf6-eb6de298e07b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:26.787911 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b37635cd-990a-4715-adf6-eb6de298e07b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:26.791090 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b37635cd-990a-4715-adf6-eb6de298e07b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:26.792362 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b37635cd-990a-4715-adf6-eb6de298e07b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:27.191027 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b37635cd-990a-4715-adf6-eb6de298e07b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:27.214713 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b37635cd-990a-4715-adf6-eb6de298e07b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1547 microversion: 2.1 time: 0.470049 Feb 08 17:34:27.230751 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 395/812] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:26 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1547 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:27.349924 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4f15985c-d2d9-4a29-a12a-0180197005d6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:27.350567 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4f15985c-d2d9-4a29-a12a-0180197005d6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:27.360746 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4f15985c-d2d9-4a29-a12a-0180197005d6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:27.361624 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4f15985c-d2d9-4a29-a12a-0180197005d6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:27.365050 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4f15985c-d2d9-4a29-a12a-0180197005d6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:27.365935 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4f15985c-d2d9-4a29-a12a-0180197005d6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:27.628260 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4f15985c-d2d9-4a29-a12a-0180197005d6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:27.648701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4f15985c-d2d9-4a29-a12a-0180197005d6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.306696 Feb 08 17:34:27.650386 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 418/813] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:27 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:28.242844 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-db1ab809-2aaf-43e4-94d5-4e53d9317abb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:28.243374 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-db1ab809-2aaf-43e4-94d5-4e53d9317abb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:28.253883 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-db1ab809-2aaf-43e4-94d5-4e53d9317abb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:28.254703 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-db1ab809-2aaf-43e4-94d5-4e53d9317abb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:28.256200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-db1ab809-2aaf-43e4-94d5-4e53d9317abb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:28.257008 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-db1ab809-2aaf-43e4-94d5-4e53d9317abb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:28.498515 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-db1ab809-2aaf-43e4-94d5-4e53d9317abb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:28.512384 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-db1ab809-2aaf-43e4-94d5-4e53d9317abb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1665 microversion: 2.1 time: 0.272938 Feb 08 17:34:28.513481 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 396/814] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:28 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1665 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:28.540723 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1944b901-f120-4282-8e78-1deb7be9d673 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:28.542383 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1944b901-f120-4282-8e78-1deb7be9d673 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:28.552273 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1944b901-f120-4282-8e78-1deb7be9d673 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:28.553025 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1944b901-f120-4282-8e78-1deb7be9d673 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:28.554559 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1944b901-f120-4282-8e78-1deb7be9d673 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:28.555546 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1944b901-f120-4282-8e78-1deb7be9d673 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:28.600993 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1944b901-f120-4282-8e78-1deb7be9d673 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/ips" status: 200 len: 144 microversion: 2.1 time: 0.066425 Feb 08 17:34:28.602537 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 419/815] 10.222.0.69 () {58 vars in 1247 bytes} [Tue Feb 8 17:34:28 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/ips => generated 144 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:28.678098 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e7871739-81cc-4626-8e35-7dd5ee600d7c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:28.679223 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-e7871739-81cc-4626-8e35-7dd5ee600d7c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:28.688684 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e7871739-81cc-4626-8e35-7dd5ee600d7c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:28.689634 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e7871739-81cc-4626-8e35-7dd5ee600d7c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:28.691048 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e7871739-81cc-4626-8e35-7dd5ee600d7c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:28.691749 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e7871739-81cc-4626-8e35-7dd5ee600d7c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:28.965944 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e7871739-81cc-4626-8e35-7dd5ee600d7c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:28.978830 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e7871739-81cc-4626-8e35-7dd5ee600d7c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.307491 Feb 08 17:34:28.979865 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 397/816] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:28 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:30.016996 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-dc78df22-2c06-441a-acbb-2e789923f20e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:30.018185 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-dc78df22-2c06-441a-acbb-2e789923f20e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:30.030464 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dc78df22-2c06-441a-acbb-2e789923f20e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:30.031268 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dc78df22-2c06-441a-acbb-2e789923f20e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:30.032704 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dc78df22-2c06-441a-acbb-2e789923f20e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:30.033526 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dc78df22-2c06-441a-acbb-2e789923f20e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:30.297967 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-dc78df22-2c06-441a-acbb-2e789923f20e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:30.311231 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-dc78df22-2c06-441a-acbb-2e789923f20e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.300897 Feb 08 17:34:30.312257 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 420/817] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:30 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:31.337787 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ff07767f-fd9f-45eb-96fc-913e7892a434 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:31.339041 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ff07767f-fd9f-45eb-96fc-913e7892a434 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:31.350743 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ff07767f-fd9f-45eb-96fc-913e7892a434 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:31.351531 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ff07767f-fd9f-45eb-96fc-913e7892a434 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:31.352973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ff07767f-fd9f-45eb-96fc-913e7892a434 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:31.354365 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ff07767f-fd9f-45eb-96fc-913e7892a434 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:31.598874 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ff07767f-fd9f-45eb-96fc-913e7892a434 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:31.611776 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ff07767f-fd9f-45eb-96fc-913e7892a434 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.280758 Feb 08 17:34:31.613031 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 398/818] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:31 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:32.638991 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e41f56af-cc1e-462f-a261-e54c07478c40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:32.640035 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e41f56af-cc1e-462f-a261-e54c07478c40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:32.650952 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e41f56af-cc1e-462f-a261-e54c07478c40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:32.651654 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e41f56af-cc1e-462f-a261-e54c07478c40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:32.652914 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e41f56af-cc1e-462f-a261-e54c07478c40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:32.653655 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e41f56af-cc1e-462f-a261-e54c07478c40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:32.895265 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e41f56af-cc1e-462f-a261-e54c07478c40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:32.906777 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e41f56af-cc1e-462f-a261-e54c07478c40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.273867 Feb 08 17:34:32.907027 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 421/819] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:32 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:33.424848 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cfcf60c1-5688-4845-8db1-6773735d7615 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b811a964-cf95-4bdf-aaae-be4ac1f336cf"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:33.426764 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-cfcf60c1-5688-4845-8db1-6773735d7615 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:33.437517 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cfcf60c1-5688-4845-8db1-6773735d7615 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:33.438227 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cfcf60c1-5688-4845-8db1-6773735d7615 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:33.439527 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cfcf60c1-5688-4845-8db1-6773735d7615 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:33.440196 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cfcf60c1-5688-4845-8db1-6773735d7615 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:33.848706 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cfcf60c1-5688-4845-8db1-6773735d7615 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "POST /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430144 Feb 08 17:34:33.856892 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 399/820] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:34:33 2022] POST /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments => generated 194 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:33.936849 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f7102acd-1dde-467e-b487-87be5d86b063 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:33.938104 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f7102acd-1dde-467e-b487-87be5d86b063 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:33.951290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7102acd-1dde-467e-b487-87be5d86b063 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:33.952163 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7102acd-1dde-467e-b487-87be5d86b063 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:33.953871 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7102acd-1dde-467e-b487-87be5d86b063 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:33.955492 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7102acd-1dde-467e-b487-87be5d86b063 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:34.266621 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f7102acd-1dde-467e-b487-87be5d86b063 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:34.282454 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f7102acd-1dde-467e-b487-87be5d86b063 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.349245 Feb 08 17:34:34.288501 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 422/821] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:33 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:34.466321 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-f39fd4d8-f9d7-4f2e-a0e6-3a7d5aa444aa req-cfe7a12e-232f-4868-8ac9-9dd5a1cde734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39b3cf2-49f7-4975-95ef-116f071d7040", "name": "network-vif-plugged", "status": "completed", "tag": "0c3ed2a4-e2ce-42dc-95fa-e4ce5541a2f6"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:34.475165 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:34:34.475165 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:34:34.501668 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-f39fd4d8-f9d7-4f2e-a0e6-3a7d5aa444aa req-cfe7a12e-232f-4868-8ac9-9dd5a1cde734 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:34.503587 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-f39fd4d8-f9d7-4f2e-a0e6-3a7d5aa444aa req-cfe7a12e-232f-4868-8ac9-9dd5a1cde734 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:34.543468 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-f39fd4d8-f9d7-4f2e-a0e6-3a7d5aa444aa req-cfe7a12e-232f-4868-8ac9-9dd5a1cde734 service nova] Creating event network-vif-plugged:0c3ed2a4-e2ce-42dc-95fa-e4ce5541a2f6 for instance b39b3cf2-49f7-4975-95ef-116f071d7040 on hv-cinder-82204 Feb 08 17:34:34.557358 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-f39fd4d8-f9d7-4f2e-a0e6-3a7d5aa444aa req-cfe7a12e-232f-4868-8ac9-9dd5a1cde734 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105304 Feb 08 17:34:34.559525 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 400/822] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:35.306622 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-223d72db-ec85-44c0-9e2d-1b3f1184c4cc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:35.307589 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-223d72db-ec85-44c0-9e2d-1b3f1184c4cc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:35.319625 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-223d72db-ec85-44c0-9e2d-1b3f1184c4cc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:35.320448 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-223d72db-ec85-44c0-9e2d-1b3f1184c4cc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:35.322116 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-223d72db-ec85-44c0-9e2d-1b3f1184c4cc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:35.322992 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-223d72db-ec85-44c0-9e2d-1b3f1184c4cc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:35.571129 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-223d72db-ec85-44c0-9e2d-1b3f1184c4cc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:35.585681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-223d72db-ec85-44c0-9e2d-1b3f1184c4cc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.285054 Feb 08 17:34:35.586754 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 423/823] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:35 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:36.611655 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-47dc3fd7-0931-42e0-9cc0-69d72c25522d tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:36.613149 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-47dc3fd7-0931-42e0-9cc0-69d72c25522d tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:36.624702 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-47dc3fd7-0931-42e0-9cc0-69d72c25522d tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:36.625522 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-47dc3fd7-0931-42e0-9cc0-69d72c25522d tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:36.627715 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-47dc3fd7-0931-42e0-9cc0-69d72c25522d tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:36.628348 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-47dc3fd7-0931-42e0-9cc0-69d72c25522d tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:36.872013 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-47dc3fd7-0931-42e0-9cc0-69d72c25522d tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:36.886527 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-47dc3fd7-0931-42e0-9cc0-69d72c25522d tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1318 microversion: 2.1 time: 0.280705 Feb 08 17:34:36.887543 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 401/824] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:36 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:37.912103 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-08f30046-b850-4016-984d-b35f30e3cf40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:37.913317 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-08f30046-b850-4016-984d-b35f30e3cf40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:37.923361 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-08f30046-b850-4016-984d-b35f30e3cf40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:37.924132 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-08f30046-b850-4016-984d-b35f30e3cf40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:37.925627 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-08f30046-b850-4016-984d-b35f30e3cf40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:37.926420 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-08f30046-b850-4016-984d-b35f30e3cf40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:38.172796 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-08f30046-b850-4016-984d-b35f30e3cf40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:34:38.182535 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-08f30046-b850-4016-984d-b35f30e3cf40 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1506 microversion: 2.1 time: 0.276600 Feb 08 17:34:38.183399 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 424/825] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:34:37 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:34:39.845682 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0c164160-4ddd-4de9-bdeb-9159572fc8fc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe754183-2f40-4b24-bd8d-e345b06e36f0"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:39.846918 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0c164160-4ddd-4de9-bdeb-9159572fc8fc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:39.856907 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c164160-4ddd-4de9-bdeb-9159572fc8fc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:39.857780 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c164160-4ddd-4de9-bdeb-9159572fc8fc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:39.859413 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c164160-4ddd-4de9-bdeb-9159572fc8fc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:39.860206 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0c164160-4ddd-4de9-bdeb-9159572fc8fc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:43.838478 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0c164160-4ddd-4de9-bdeb-9159572fc8fc tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "POST /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.998073 Feb 08 17:34:43.839620 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 402/826] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:34:39 2022] POST /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments => generated 194 bytes in 4002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:46.190360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-eb1cb3d9-bf0d-404f-84ea-71783e3d9b94 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:46.191908 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-eb1cb3d9-bf0d-404f-84ea-71783e3d9b94 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:46.204337 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eb1cb3d9-bf0d-404f-84ea-71783e3d9b94 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:46.205145 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eb1cb3d9-bf0d-404f-84ea-71783e3d9b94 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:46.206749 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eb1cb3d9-bf0d-404f-84ea-71783e3d9b94 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:46.207565 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eb1cb3d9-bf0d-404f-84ea-71783e3d9b94 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:46.265959 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-eb1cb3d9-bf0d-404f-84ea-71783e3d9b94 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082299 Feb 08 17:34:46.266620 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 425/827] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:34:46 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:46.284854 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-00f18eaa-86ab-4fd6-aee6-2e8eaf974a81 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:46.285872 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-00f18eaa-86ab-4fd6-aee6-2e8eaf974a81 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:46.297401 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-00f18eaa-86ab-4fd6-aee6-2e8eaf974a81 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:46.298212 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-00f18eaa-86ab-4fd6-aee6-2e8eaf974a81 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:46.299574 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-00f18eaa-86ab-4fd6-aee6-2e8eaf974a81 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:46.300277 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-00f18eaa-86ab-4fd6-aee6-2e8eaf974a81 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:46.357681 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-00f18eaa-86ab-4fd6-aee6-2e8eaf974a81 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments/b811a964-cf95-4bdf-aaae-be4ac1f336cf" status: 200 len: 194 microversion: 2.1 time: 0.081756 Feb 08 17:34:46.358891 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 403/828] 10.222.0.69 () {58 vars in 1412 bytes} [Tue Feb 8 17:34:46 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments/b811a964-cf95-4bdf-aaae-be4ac1f336cf => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:47.894011 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-095a698a-e2a4-4ea1-ae54-0862d61799b5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceca058c-6e42-40ae-87f3-d7a21f9e9ad2"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:34:47.895751 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-095a698a-e2a4-4ea1-ae54-0862d61799b5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:47.904110 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-095a698a-e2a4-4ea1-ae54-0862d61799b5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:47.904908 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-095a698a-e2a4-4ea1-ae54-0862d61799b5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:47.905896 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-095a698a-e2a4-4ea1-ae54-0862d61799b5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:47.906379 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-095a698a-e2a4-4ea1-ae54-0862d61799b5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:48.297366 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-095a698a-e2a4-4ea1-ae54-0862d61799b5 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "POST /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409714 Feb 08 17:34:48.298458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 426/829] 10.222.0.69 () {60 vars in 1322 bytes} [Tue Feb 8 17:34:47 2022] POST /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:52.924463 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a5cb64f3-ee1e-4003-86ae-d48f2b90e38a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:52.925407 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a5cb64f3-ee1e-4003-86ae-d48f2b90e38a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:52.934365 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a5cb64f3-ee1e-4003-86ae-d48f2b90e38a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:52.934979 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a5cb64f3-ee1e-4003-86ae-d48f2b90e38a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:52.935834 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a5cb64f3-ee1e-4003-86ae-d48f2b90e38a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:52.936400 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a5cb64f3-ee1e-4003-86ae-d48f2b90e38a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:53.045796 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-a5cb64f3-ee1e-4003-86ae-d48f2b90e38a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lazy-loading 'services' on Instance uuid b39b3cf2-49f7-4975-95ef-116f071d7040 {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:34:53.150364 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a5cb64f3-ee1e-4003-86ae-d48f2b90e38a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments/fe754183-2f40-4b24-bd8d-e345b06e36f0" status: 202 len: 0 microversion: 2.1 time: 0.229590 Feb 08 17:34:53.151069 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 404/830] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:34:52 2022] DELETE /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments/fe754183-2f40-4b24-bd8d-e345b06e36f0 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:34:53.167595 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c5325730-85c4-434c-86f3-33de650b498a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:53.169619 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c5325730-85c4-434c-86f3-33de650b498a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:53.181537 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c5325730-85c4-434c-86f3-33de650b498a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:53.182379 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c5325730-85c4-434c-86f3-33de650b498a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:53.183831 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c5325730-85c4-434c-86f3-33de650b498a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:53.184844 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c5325730-85c4-434c-86f3-33de650b498a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:53.246317 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c5325730-85c4-434c-86f3-33de650b498a tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088902 Feb 08 17:34:53.247836 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 427/831] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:34:53 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:54.267645 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f20b58a0-0bf6-4c40-81c2-96c2d5b8bca4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:54.270732 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f20b58a0-0bf6-4c40-81c2-96c2d5b8bca4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:54.279340 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f20b58a0-0bf6-4c40-81c2-96c2d5b8bca4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:54.279853 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f20b58a0-0bf6-4c40-81c2-96c2d5b8bca4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:54.280805 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f20b58a0-0bf6-4c40-81c2-96c2d5b8bca4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:54.281302 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f20b58a0-0bf6-4c40-81c2-96c2d5b8bca4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:54.324922 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f20b58a0-0bf6-4c40-81c2-96c2d5b8bca4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064366 Feb 08 17:34:54.325530 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 405/832] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:34:54 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:55.341855 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7d26fb42-db95-497e-a6b6-7a136d3d103c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:55.343020 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7d26fb42-db95-497e-a6b6-7a136d3d103c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:55.351306 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d26fb42-db95-497e-a6b6-7a136d3d103c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:55.351912 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d26fb42-db95-497e-a6b6-7a136d3d103c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:55.353349 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d26fb42-db95-497e-a6b6-7a136d3d103c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:55.353787 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d26fb42-db95-497e-a6b6-7a136d3d103c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:55.402997 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7d26fb42-db95-497e-a6b6-7a136d3d103c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067810 Feb 08 17:34:55.404667 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 428/833] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:34:55 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:56.417539 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3c70052a-6f75-473a-91d5-fbb19ae171cd tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:56.418783 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3c70052a-6f75-473a-91d5-fbb19ae171cd tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:56.428060 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3c70052a-6f75-473a-91d5-fbb19ae171cd tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:56.428870 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3c70052a-6f75-473a-91d5-fbb19ae171cd tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:56.430331 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3c70052a-6f75-473a-91d5-fbb19ae171cd tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:56.431593 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3c70052a-6f75-473a-91d5-fbb19ae171cd tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:56.477617 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3c70052a-6f75-473a-91d5-fbb19ae171cd tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064716 Feb 08 17:34:56.478293 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 406/834] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:34:56 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:57.494947 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9fdb3e2f-f8b4-43c3-9dcd-39ff2ed0e489 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:57.496872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9fdb3e2f-f8b4-43c3-9dcd-39ff2ed0e489 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:57.507430 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fdb3e2f-f8b4-43c3-9dcd-39ff2ed0e489 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:57.508289 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fdb3e2f-f8b4-43c3-9dcd-39ff2ed0e489 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:57.510033 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fdb3e2f-f8b4-43c3-9dcd-39ff2ed0e489 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:57.510767 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fdb3e2f-f8b4-43c3-9dcd-39ff2ed0e489 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:57.570263 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9fdb3e2f-f8b4-43c3-9dcd-39ff2ed0e489 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081569 Feb 08 17:34:57.571889 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 429/835] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:34:57 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:34:58.585128 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-79ffdc26-d9fc-4b54-9afe-667ee6e8a6e8 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:58.586539 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-79ffdc26-d9fc-4b54-9afe-667ee6e8a6e8 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:58.597251 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-79ffdc26-d9fc-4b54-9afe-667ee6e8a6e8 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:58.597928 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-79ffdc26-d9fc-4b54-9afe-667ee6e8a6e8 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:58.599590 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-79ffdc26-d9fc-4b54-9afe-667ee6e8a6e8 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:58.600632 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-79ffdc26-d9fc-4b54-9afe-667ee6e8a6e8 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:58.666049 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-79ffdc26-d9fc-4b54-9afe-667ee6e8a6e8 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085488 Feb 08 17:34:58.667800 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 407/836] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:34:58 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:34:59.683795 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-53eb8204-f70d-447d-af94-211ccd010b3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:34:59.684840 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-53eb8204-f70d-447d-af94-211ccd010b3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:34:59.695375 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-53eb8204-f70d-447d-af94-211ccd010b3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:59.696595 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-53eb8204-f70d-447d-af94-211ccd010b3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:59.697787 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-53eb8204-f70d-447d-af94-211ccd010b3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:34:59.698553 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-53eb8204-f70d-447d-af94-211ccd010b3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:34:59.761800 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-53eb8204-f70d-447d-af94-211ccd010b3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083663 Feb 08 17:34:59.765336 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 430/837] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:34:59 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:00.778835 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6a796ce3-8cd7-4f72-8c56-3aa7788b8526 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:00.781658 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6a796ce3-8cd7-4f72-8c56-3aa7788b8526 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:00.804622 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6a796ce3-8cd7-4f72-8c56-3aa7788b8526 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:00.805831 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6a796ce3-8cd7-4f72-8c56-3aa7788b8526 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:00.807234 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6a796ce3-8cd7-4f72-8c56-3aa7788b8526 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:00.808021 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6a796ce3-8cd7-4f72-8c56-3aa7788b8526 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:00.883922 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6a796ce3-8cd7-4f72-8c56-3aa7788b8526 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111583 Feb 08 17:35:00.886550 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 408/838] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:35:00 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:01.653213 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-db77d6a9-3d3f-4276-bcc1-641d0d56857e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:01.654625 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-db77d6a9-3d3f-4276-bcc1-641d0d56857e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:01.667896 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-db77d6a9-3d3f-4276-bcc1-641d0d56857e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:01.669124 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-db77d6a9-3d3f-4276-bcc1-641d0d56857e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:01.670980 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-db77d6a9-3d3f-4276-bcc1-641d0d56857e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:01.672129 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-db77d6a9-3d3f-4276-bcc1-641d0d56857e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:01.733677 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-db77d6a9-3d3f-4276-bcc1-641d0d56857e tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.086771 Feb 08 17:35:01.735175 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 431/839] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:35:01 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments => generated 371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:35:01.904781 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d2bc2a21-c268-4844-b511-aa9939acb61e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:01.919185 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d2bc2a21-c268-4844-b511-aa9939acb61e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:01.931016 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d2bc2a21-c268-4844-b511-aa9939acb61e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:01.932557 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d2bc2a21-c268-4844-b511-aa9939acb61e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:01.934396 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d2bc2a21-c268-4844-b511-aa9939acb61e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:01.935683 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d2bc2a21-c268-4844-b511-aa9939acb61e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:02.025233 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d2bc2a21-c268-4844-b511-aa9939acb61e tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127547 Feb 08 17:35:02.027265 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 409/840] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:35:01 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 17:35:03.429770 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d09b12fe-c00b-42e3-98f9-1d895e8936c6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:03.430517 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d09b12fe-c00b-42e3-98f9-1d895e8936c6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:03.440938 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d09b12fe-c00b-42e3-98f9-1d895e8936c6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:03.441637 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d09b12fe-c00b-42e3-98f9-1d895e8936c6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:03.442686 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d09b12fe-c00b-42e3-98f9-1d895e8936c6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:03.443168 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d09b12fe-c00b-42e3-98f9-1d895e8936c6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:03.518554 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d09b12fe-c00b-42e3-98f9-1d895e8936c6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:35:03.659620 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d09b12fe-c00b-42e3-98f9-1d895e8936c6 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 204 len: 0 microversion: 2.1 time: 0.233943 Feb 08 17:35:03.661963 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 432/841] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:35:03 2022] DELETE /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:35:03.673775 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4ccd8e62-036a-44c4-b352-19a9af30ad12 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:03.674927 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4ccd8e62-036a-44c4-b352-19a9af30ad12 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:03.689199 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4ccd8e62-036a-44c4-b352-19a9af30ad12 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:03.690030 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4ccd8e62-036a-44c4-b352-19a9af30ad12 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:03.691253 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4ccd8e62-036a-44c4-b352-19a9af30ad12 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:03.691907 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4ccd8e62-036a-44c4-b352-19a9af30ad12 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:04.264793 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4ccd8e62-036a-44c4-b352-19a9af30ad12 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:04.279580 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4ccd8e62-036a-44c4-b352-19a9af30ad12 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1512 microversion: 2.1 time: 0.610778 Feb 08 17:35:04.281355 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 410/842] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:03 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1512 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:05.312867 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-14bcd20b-1eb0-45a7-bec3-2e525783b7ad tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:05.314633 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-14bcd20b-1eb0-45a7-bec3-2e525783b7ad tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:05.328711 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-14bcd20b-1eb0-45a7-bec3-2e525783b7ad tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:05.329537 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-14bcd20b-1eb0-45a7-bec3-2e525783b7ad tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:05.331006 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-14bcd20b-1eb0-45a7-bec3-2e525783b7ad tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:05.331825 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-14bcd20b-1eb0-45a7-bec3-2e525783b7ad tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:05.632371 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-14bcd20b-1eb0-45a7-bec3-2e525783b7ad tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:05.653757 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-14bcd20b-1eb0-45a7-bec3-2e525783b7ad tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1512 microversion: 2.1 time: 0.350156 Feb 08 17:35:05.654897 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 433/843] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:05 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:06.685889 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-85f745ba-cd50-44c8-b62c-131a0d68b656 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:06.687786 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-85f745ba-cd50-44c8-b62c-131a0d68b656 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:06.701292 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-85f745ba-cd50-44c8-b62c-131a0d68b656 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:06.701521 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-85f745ba-cd50-44c8-b62c-131a0d68b656 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:06.702571 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-85f745ba-cd50-44c8-b62c-131a0d68b656 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:06.703035 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-85f745ba-cd50-44c8-b62c-131a0d68b656 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:07.845346 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-85f745ba-cd50-44c8-b62c-131a0d68b656 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:07.874918 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-85f745ba-cd50-44c8-b62c-131a0d68b656 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1512 microversion: 2.1 time: 1.196125 Feb 08 17:35:07.881355 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 411/844] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:06 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1512 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:08.910186 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-42fa8f0f-d6ad-4267-aa0d-482151cfd5cb tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:08.912236 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-42fa8f0f-d6ad-4267-aa0d-482151cfd5cb tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:08.927576 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-42fa8f0f-d6ad-4267-aa0d-482151cfd5cb tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:08.928477 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-42fa8f0f-d6ad-4267-aa0d-482151cfd5cb tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:08.931640 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-42fa8f0f-d6ad-4267-aa0d-482151cfd5cb tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:08.933965 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-42fa8f0f-d6ad-4267-aa0d-482151cfd5cb tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:09.124798 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-42fa8f0f-d6ad-4267-aa0d-482151cfd5cb tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:09.157248 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-42fa8f0f-d6ad-4267-aa0d-482151cfd5cb tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1470 microversion: 2.1 time: 0.252725 Feb 08 17:35:09.167478 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 434/845] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:08 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:09.218907 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-66b5f6d8-a164-49d8-9805-564ee09aff71 req-1fe07c69-7484-4613-a9a6-dd271266cbcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39b3cf2-49f7-4975-95ef-116f071d7040", "name": "network-vif-deleted", "tag": "0c3ed2a4-e2ce-42dc-95fa-e4ce5541a2f6"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:09.233940 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:35:09.233940 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:35:09.270217 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-66b5f6d8-a164-49d8-9805-564ee09aff71 req-1fe07c69-7484-4613-a9a6-dd271266cbcb service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:09.270876 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-66b5f6d8-a164-49d8-9805-564ee09aff71 req-1fe07c69-7484-4613-a9a6-dd271266cbcb service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:09.340629 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-66b5f6d8-a164-49d8-9805-564ee09aff71 req-1fe07c69-7484-4613-a9a6-dd271266cbcb service nova] Creating event network-vif-deleted:0c3ed2a4-e2ce-42dc-95fa-e4ce5541a2f6 for instance b39b3cf2-49f7-4975-95ef-116f071d7040 on hv-cinder-82204 Feb 08 17:35:09.379398 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-66b5f6d8-a164-49d8-9805-564ee09aff71 req-1fe07c69-7484-4613-a9a6-dd271266cbcb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171997 Feb 08 17:35:09.387344 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 412/846] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:35:10.187036 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6c0f2428-9153-4658-90e0-435185439421 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:10.188998 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6c0f2428-9153-4658-90e0-435185439421 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:10.202521 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6c0f2428-9153-4658-90e0-435185439421 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:10.205904 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6c0f2428-9153-4658-90e0-435185439421 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:10.207050 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6c0f2428-9153-4658-90e0-435185439421 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:10.214425 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6c0f2428-9153-4658-90e0-435185439421 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:10.320613 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6c0f2428-9153-4658-90e0-435185439421 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:10.321539 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6c0f2428-9153-4658-90e0-435185439421 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:10.322656 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-6c0f2428-9153-4658-90e0-435185439421 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lazy-loading 'fault' on Instance uuid b39b3cf2-49f7-4975-95ef-116f071d7040 {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:35:10.402168 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6c0f2428-9153-4658-90e0-435185439421 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:10.418806 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6c0f2428-9153-4658-90e0-435185439421 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 200 len: 1308 microversion: 2.1 time: 0.236935 Feb 08 17:35:10.420436 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 435/847] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:10 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 1308 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:11.448840 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-674ee6a8-5b1b-4b85-b057-c3f9ab45342c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:11.450979 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-674ee6a8-5b1b-4b85-b057-c3f9ab45342c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: b39b3cf2-49f7-4975-95ef-116f071d7040] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:11.460569 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-674ee6a8-5b1b-4b85-b057-c3f9ab45342c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:11.461800 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-674ee6a8-5b1b-4b85-b057-c3f9ab45342c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:11.463015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-674ee6a8-5b1b-4b85-b057-c3f9ab45342c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:11.463529 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-674ee6a8-5b1b-4b85-b057-c3f9ab45342c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:11.496896 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-674ee6a8-5b1b-4b85-b057-c3f9ab45342c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] HTTP exception thrown: Instance b39b3cf2-49f7-4975-95ef-116f071d7040 could not be found. Feb 08 17:35:11.497540 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-674ee6a8-5b1b-4b85-b057-c3f9ab45342c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Returning 404 to user: Instance b39b3cf2-49f7-4975-95ef-116f071d7040 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:35:11.498710 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-674ee6a8-5b1b-4b85-b057-c3f9ab45342c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040" status: 404 len: 111 microversion: 2.1 time: 0.056967 Feb 08 17:35:11.500213 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 413/848] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:11 2022] GET /compute/v2.1/servers/b39b3cf2-49f7-4975-95ef-116f071d7040 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:35:12.751458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-37a95e8d-55f3-4b82-82cb-dcfbdf839f3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:12.752968 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-37a95e8d-55f3-4b82-82cb-dcfbdf839f3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:12.763194 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-37a95e8d-55f3-4b82-82cb-dcfbdf839f3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:12.773043 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-37a95e8d-55f3-4b82-82cb-dcfbdf839f3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:12.785512 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-37a95e8d-55f3-4b82-82cb-dcfbdf839f3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:12.787600 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-37a95e8d-55f3-4b82-82cb-dcfbdf839f3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:12.848637 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-37a95e8d-55f3-4b82-82cb-dcfbdf839f3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:35:12.990994 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-37a95e8d-55f3-4b82-82cb-dcfbdf839f3c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "DELETE /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 204 len: 0 microversion: 2.1 time: 0.243624 Feb 08 17:35:12.999388 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 436/849] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:35:12 2022] DELETE /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:35:13.014160 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-65e201c0-6cdf-45e8-8ba6-c35399864cd3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:13.015082 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-65e201c0-6cdf-45e8-8ba6-c35399864cd3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:13.037622 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-65e201c0-6cdf-45e8-8ba6-c35399864cd3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:13.038410 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-65e201c0-6cdf-45e8-8ba6-c35399864cd3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:13.040384 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-65e201c0-6cdf-45e8-8ba6-c35399864cd3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:13.041190 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-65e201c0-6cdf-45e8-8ba6-c35399864cd3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:13.510609 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-65e201c0-6cdf-45e8-8ba6-c35399864cd3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:13.534270 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-65e201c0-6cdf-45e8-8ba6-c35399864cd3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1512 microversion: 2.1 time: 0.528797 Feb 08 17:35:13.553192 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 414/850] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:13 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1512 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:35:14.371052 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-24f3bcbe-8d59-4de3-ae28-2cd023fb730f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Action: 'create', calling method: .version_select at 0x7fd9fa1138b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-951021457"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:14.389620 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-24f3bcbe-8d59-4de3-ae28-2cd023fb730f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Getting quotas for project 28ccc8eef185498e9ceeef80e17e6481. Resources: {'key_pairs'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:35:14.409350 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-24f3bcbe-8d59-4de3-ae28-2cd023fb730f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Getting quotas for user 8379ee89f3474da488245ea1d34e704a and project 28ccc8eef185498e9ceeef80e17e6481. Resources: {'key_pairs'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:35:14.455556 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: ERROR oslo.messaging._drivers.impl_rabbit [None req-24f3bcbe-8d59-4de3-ae28-2cd023fb730f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [e45b79f8-0c3c-4e06-8186-0f906bb5f154] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 08 17:35:14.572069 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-496f9706-2373-4284-87a7-33e3bd08559c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:14.572670 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-496f9706-2373-4284-87a7-33e3bd08559c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:14.583796 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-496f9706-2373-4284-87a7-33e3bd08559c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:14.584418 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-496f9706-2373-4284-87a7-33e3bd08559c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:14.585908 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-496f9706-2373-4284-87a7-33e3bd08559c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:14.586690 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-496f9706-2373-4284-87a7-33e3bd08559c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:14.779800 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-496f9706-2373-4284-87a7-33e3bd08559c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:14.787868 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-496f9706-2373-4284-87a7-33e3bd08559c tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1512 microversion: 2.1 time: 0.220277 Feb 08 17:35:14.789570 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 415/851] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:14 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:35:15.465049 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [None req-24f3bcbe-8d59-4de3-ae28-2cd023fb730f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [e45b79f8-0c3c-4e06-8186-0f906bb5f154] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 41314. Feb 08 17:35:15.655007 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-24f3bcbe-8d59-4de3-ae28-2cd023fb730f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Getting quotas for project 28ccc8eef185498e9ceeef80e17e6481. Resources: {'key_pairs'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:35:15.659752 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-24f3bcbe-8d59-4de3-ae28-2cd023fb730f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Getting quotas for user 8379ee89f3474da488245ea1d34e704a and project 28ccc8eef185498e9ceeef80e17e6481. Resources: {'key_pairs'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:35:15.679100 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-24f3bcbe-8d59-4de3-ae28-2cd023fb730f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.577768 Feb 08 17:35:15.680428 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 437/852] 10.222.0.69 () {60 vars in 1157 bytes} [Tue Feb 8 17:35:14 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:15.813869 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a218f96b-6338-456a-86ce-29b298bfc876 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:15.816045 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a218f96b-6338-456a-86ce-29b298bfc876 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:15.826503 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a218f96b-6338-456a-86ce-29b298bfc876 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:15.827523 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a218f96b-6338-456a-86ce-29b298bfc876 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:15.828449 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a218f96b-6338-456a-86ce-29b298bfc876 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:15.828849 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a218f96b-6338-456a-86ce-29b298bfc876 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:16.291204 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a218f96b-6338-456a-86ce-29b298bfc876 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:16.304031 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a218f96b-6338-456a-86ce-29b298bfc876 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1512 microversion: 2.1 time: 0.495732 Feb 08 17:35:16.306451 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 416/853] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:15 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1512 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:16.931387 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-030a95cb-206c-463d-8f77-41a514c353bb req-f503d57e-3ca9-45be-852f-6c83b72f21dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73830e35-4e4d-4ca1-a5db-75fe7400fc4c", "name": "network-vif-deleted", "tag": "c0746dd4-2e81-48be-9572-611238bd7c8e"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:16.933235 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:35:16.933235 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:35:16.945743 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-030a95cb-206c-463d-8f77-41a514c353bb req-f503d57e-3ca9-45be-852f-6c83b72f21dd service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:16.950192 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-030a95cb-206c-463d-8f77-41a514c353bb req-f503d57e-3ca9-45be-852f-6c83b72f21dd service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:16.970837 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-030a95cb-206c-463d-8f77-41a514c353bb req-f503d57e-3ca9-45be-852f-6c83b72f21dd service nova] Creating event network-vif-deleted:c0746dd4-2e81-48be-9572-611238bd7c8e for instance 73830e35-4e4d-4ca1-a5db-75fe7400fc4c on hv-cinder-82204 Feb 08 17:35:16.980538 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-030a95cb-206c-463d-8f77-41a514c353bb req-f503d57e-3ca9-45be-852f-6c83b72f21dd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052694 Feb 08 17:35:16.984366 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 438/854] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:17.326269 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d81c2f09-64b3-4af0-bc40-b46c8d172bb0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:17.327108 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d81c2f09-64b3-4af0-bc40-b46c8d172bb0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:17.336764 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d81c2f09-64b3-4af0-bc40-b46c8d172bb0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:17.337138 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d81c2f09-64b3-4af0-bc40-b46c8d172bb0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:17.337981 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d81c2f09-64b3-4af0-bc40-b46c8d172bb0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:17.338449 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d81c2f09-64b3-4af0-bc40-b46c8d172bb0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:17.390892 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d81c2f09-64b3-4af0-bc40-b46c8d172bb0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:17.391309 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d81c2f09-64b3-4af0-bc40-b46c8d172bb0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:17.392021 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-d81c2f09-64b3-4af0-bc40-b46c8d172bb0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lazy-loading 'fault' on Instance uuid 73830e35-4e4d-4ca1-a5db-75fe7400fc4c {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:35:17.470470 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d81c2f09-64b3-4af0-bc40-b46c8d172bb0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:17.492914 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d81c2f09-64b3-4af0-bc40-b46c8d172bb0 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 200 len: 1308 microversion: 2.1 time: 0.163473 Feb 08 17:35:17.494078 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 417/855] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:17 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:18.522532 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ba0a7c1f-6e22-4f32-a180-91a66b9791f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:18.526307 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ba0a7c1f-6e22-4f32-a180-91a66b9791f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 73830e35-4e4d-4ca1-a5db-75fe7400fc4c] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:18.545853 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ba0a7c1f-6e22-4f32-a180-91a66b9791f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:18.546724 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ba0a7c1f-6e22-4f32-a180-91a66b9791f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:18.549126 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ba0a7c1f-6e22-4f32-a180-91a66b9791f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:18.550029 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ba0a7c1f-6e22-4f32-a180-91a66b9791f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:18.583246 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-ba0a7c1f-6e22-4f32-a180-91a66b9791f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] HTTP exception thrown: Instance 73830e35-4e4d-4ca1-a5db-75fe7400fc4c could not be found. Feb 08 17:35:18.585180 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ba0a7c1f-6e22-4f32-a180-91a66b9791f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Returning 404 to user: Instance 73830e35-4e4d-4ca1-a5db-75fe7400fc4c could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:35:18.587968 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ba0a7c1f-6e22-4f32-a180-91a66b9791f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c" status: 404 len: 111 microversion: 2.1 time: 0.075072 Feb 08 17:35:18.590482 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 439/856] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:18 2022] GET /compute/v2.1/servers/73830e35-4e4d-4ca1-a5db-75fe7400fc4c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:35:18.606098 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-91a9752c-241c-458a-a43e-2e53f44f2531 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:18.608550 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-91a9752c-241c-458a-a43e-2e53f44f2531 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:18.622837 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-91a9752c-241c-458a-a43e-2e53f44f2531 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:18.624080 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-91a9752c-241c-458a-a43e-2e53f44f2531 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:18.625760 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-91a9752c-241c-458a-a43e-2e53f44f2531 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:18.626593 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-91a9752c-241c-458a-a43e-2e53f44f2531 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:18.682813 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-91a9752c-241c-458a-a43e-2e53f44f2531 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Going to try to terminate instance {{(pid=116479) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:35:18.857984 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-91a9752c-241c-458a-a43e-2e53f44f2531 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 204 len: 0 microversion: 2.1 time: 0.261773 Feb 08 17:35:18.862407 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 418/857] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:35:18 2022] DELETE /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:35:18.879893 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2a7fc9cd-1acc-4bc8-ac1f-43093e92c2f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:18.882198 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2a7fc9cd-1acc-4bc8-ac1f-43093e92c2f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:18.895320 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2a7fc9cd-1acc-4bc8-ac1f-43093e92c2f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:18.903364 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2a7fc9cd-1acc-4bc8-ac1f-43093e92c2f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:18.904913 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2a7fc9cd-1acc-4bc8-ac1f-43093e92c2f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:18.907041 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2a7fc9cd-1acc-4bc8-ac1f-43093e92c2f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:19.187663 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2a7fc9cd-1acc-4bc8-ac1f-43093e92c2f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:19.203695 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2a7fc9cd-1acc-4bc8-ac1f-43093e92c2f3 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1511 microversion: 2.1 time: 0.338187 Feb 08 17:35:19.204669 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 440/858] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:18 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:20.232204 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8a455b40-95be-4e96-9f14-a79fb63f3cf4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:20.233568 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8a455b40-95be-4e96-9f14-a79fb63f3cf4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:20.245510 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8a455b40-95be-4e96-9f14-a79fb63f3cf4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:20.246321 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8a455b40-95be-4e96-9f14-a79fb63f3cf4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:20.247922 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8a455b40-95be-4e96-9f14-a79fb63f3cf4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:20.248664 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8a455b40-95be-4e96-9f14-a79fb63f3cf4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:20.489021 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8a455b40-95be-4e96-9f14-a79fb63f3cf4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:20.507288 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8a455b40-95be-4e96-9f14-a79fb63f3cf4 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1511 microversion: 2.1 time: 0.283100 Feb 08 17:35:20.508956 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 419/859] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:20 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:21.530207 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3bc25792-10a2-48c2-8842-c70a9175600b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:21.531263 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3bc25792-10a2-48c2-8842-c70a9175600b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:21.543846 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3bc25792-10a2-48c2-8842-c70a9175600b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:21.544790 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3bc25792-10a2-48c2-8842-c70a9175600b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:21.546267 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3bc25792-10a2-48c2-8842-c70a9175600b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:21.547107 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3bc25792-10a2-48c2-8842-c70a9175600b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:21.795450 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3bc25792-10a2-48c2-8842-c70a9175600b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:21.827751 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3bc25792-10a2-48c2-8842-c70a9175600b tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 200 len: 1511 microversion: 2.1 time: 0.303399 Feb 08 17:35:21.844923 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 441/860] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:21 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 1511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:21.906844 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-8a6bfa1d-dbde-491f-a08d-b0eefcc1a26b req-47186a75-d27c-4395-88b7-bfee4ab8f173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29", "name": "network-vif-deleted", "tag": "472f6165-5949-4189-97d6-03690f24a2a5"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:21.909458 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:35:21.909458 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:35:21.918530 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-8a6bfa1d-dbde-491f-a08d-b0eefcc1a26b req-47186a75-d27c-4395-88b7-bfee4ab8f173 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:21.919298 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-8a6bfa1d-dbde-491f-a08d-b0eefcc1a26b req-47186a75-d27c-4395-88b7-bfee4ab8f173 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:21.939799 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-8a6bfa1d-dbde-491f-a08d-b0eefcc1a26b req-47186a75-d27c-4395-88b7-bfee4ab8f173 service nova] Creating event network-vif-deleted:472f6165-5949-4189-97d6-03690f24a2a5 for instance 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 on hv-cinder-82204 Feb 08 17:35:21.945859 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-8a6bfa1d-dbde-491f-a08d-b0eefcc1a26b req-47186a75-d27c-4395-88b7-bfee4ab8f173 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042923 Feb 08 17:35:21.946731 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 420/861] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:22.241456 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-84e95b04-8111-4218-9d0d-b56fa5eade90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-433200769"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:22.241997 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-84e95b04-8111-4218-9d0d-b56fa5eade90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:22.252974 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-84e95b04-8111-4218-9d0d-b56fa5eade90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:22.253710 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-84e95b04-8111-4218-9d0d-b56fa5eade90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:22.254724 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-84e95b04-8111-4218-9d0d-b56fa5eade90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:22.255458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-84e95b04-8111-4218-9d0d-b56fa5eade90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:22.437946 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.network.security_group_api [None req-84e95b04-8111-4218-9d0d-b56fa5eade90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Removing security group 63384b89-932d-4a52-8a75-530142e080eb from port 42dfed98-3788-4fc6-9076-abcd719b2bc3 Feb 08 17:35:22.860997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c831940f-b617-4ce4-9b8f-39db7e504fd9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:22.862847 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c831940f-b617-4ce4-9b8f-39db7e504fd9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:22.874042 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c831940f-b617-4ce4-9b8f-39db7e504fd9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:22.874599 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c831940f-b617-4ce4-9b8f-39db7e504fd9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:22.875436 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c831940f-b617-4ce4-9b8f-39db7e504fd9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:22.875891 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c831940f-b617-4ce4-9b8f-39db7e504fd9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:22.893976 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-c831940f-b617-4ce4-9b8f-39db7e504fd9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] HTTP exception thrown: Instance 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 could not be found. Feb 08 17:35:22.895681 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c831940f-b617-4ce4-9b8f-39db7e504fd9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Returning 404 to user: Instance 0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:35:22.896214 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c831940f-b617-4ce4-9b8f-39db7e504fd9 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29" status: 404 len: 111 microversion: 2.1 time: 0.042012 Feb 08 17:35:22.897177 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 421/862] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:22 2022] GET /compute/v2.1/servers/0f21fd8b-3a04-4a38-b8ef-e60c02aa5a29 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 17:35:23.237021 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-84e95b04-8111-4218-9d0d-b56fa5eade90 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "POST /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/action" status: 202 len: 0 microversion: 2.1 time: 0.997995 Feb 08 17:35:23.241232 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 442/863] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:35:22 2022] POST /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/action => generated 0 bytes in 1005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:35:23.250846 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-b2697368-b6b4-442a-9900-23b2442d8f53 req-92e5862a-8a70-4187-9a7a-bc76145e0445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60934cec-9d93-4ea4-9e00-ed745313db99", "tag": "42dfed98-3788-4fc6-9076-abcd719b2bc3"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:23.254800 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:35:23.254800 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:35:23.264798 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-b2697368-b6b4-442a-9900-23b2442d8f53 req-92e5862a-8a70-4187-9a7a-bc76145e0445 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:23.265564 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-b2697368-b6b4-442a-9900-23b2442d8f53 req-92e5862a-8a70-4187-9a7a-bc76145e0445 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:23.293391 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-b2697368-b6b4-442a-9900-23b2442d8f53 req-92e5862a-8a70-4187-9a7a-bc76145e0445 service nova] Creating event network-changed:42dfed98-3788-4fc6-9076-abcd719b2bc3 for instance 60934cec-9d93-4ea4-9e00-ed745313db99 on hv-cinder-82204 Feb 08 17:35:23.304314 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-b2697368-b6b4-442a-9900-23b2442d8f53 req-92e5862a-8a70-4187-9a7a-bc76145e0445 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058733 Feb 08 17:35:23.306950 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 422/864] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:24.083424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-27c8532b-1cf9-4281-84a0-c8c38507e3a5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:24.084628 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-27c8532b-1cf9-4281-84a0-c8c38507e3a5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:24.096367 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-27c8532b-1cf9-4281-84a0-c8c38507e3a5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:24.097616 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-27c8532b-1cf9-4281-84a0-c8c38507e3a5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:24.099425 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-27c8532b-1cf9-4281-84a0-c8c38507e3a5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:24.100232 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-27c8532b-1cf9-4281-84a0-c8c38507e3a5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:24.144207 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-27c8532b-1cf9-4281-84a0-c8c38507e3a5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:35:24.250918 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-27c8532b-1cf9-4281-84a0-c8c38507e3a5 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 204 len: 0 microversion: 2.1 time: 0.174847 Feb 08 17:35:24.255353 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 443/865] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:35:24 2022] DELETE /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:35:24.270284 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5c8f5b22-0a26-4da5-a389-120c75cf7c85 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:24.275445 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5c8f5b22-0a26-4da5-a389-120c75cf7c85 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:24.287608 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5c8f5b22-0a26-4da5-a389-120c75cf7c85 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:24.288351 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5c8f5b22-0a26-4da5-a389-120c75cf7c85 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:24.289982 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5c8f5b22-0a26-4da5-a389-120c75cf7c85 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:24.290425 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5c8f5b22-0a26-4da5-a389-120c75cf7c85 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:24.490369 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5c8f5b22-0a26-4da5-a389-120c75cf7c85 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:24.500123 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5c8f5b22-0a26-4da5-a389-120c75cf7c85 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1511 microversion: 2.1 time: 0.242917 Feb 08 17:35:24.500765 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 423/866] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:24 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:25.088373 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5eb7710e-ff91-474f-99ec-ca79260211c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:25.089420 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5eb7710e-ff91-474f-99ec-ca79260211c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:25.096418 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5eb7710e-ff91-474f-99ec-ca79260211c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:25.096856 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5eb7710e-ff91-474f-99ec-ca79260211c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:25.098036 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5eb7710e-ff91-474f-99ec-ca79260211c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:25.098036 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5eb7710e-ff91-474f-99ec-ca79260211c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:25.210282 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-5eb7710e-ff91-474f-99ec-ca79260211c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lazy-loading 'services' on Instance uuid 60934cec-9d93-4ea4-9e00-ed745313db99 {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:35:25.330634 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5eb7710e-ff91-474f-99ec-ca79260211c4 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "DELETE /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments/8d8f8f7e-63a2-47e3-a934-d0c0988fcfd2" status: 202 len: 0 microversion: 2.1 time: 0.248814 Feb 08 17:35:25.335061 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 444/867] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:35:25 2022] DELETE /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments/8d8f8f7e-63a2-47e3-a934-d0c0988fcfd2 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:35:25.344607 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-fc535e7d-b4ae-40e4-b4d6-c970e387d0d9 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:25.346463 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-fc535e7d-b4ae-40e4-b4d6-c970e387d0d9 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:25.348221 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-c752e715-380c-4724-b758-ae1c2c20a88f req-5490d057-4141-4adb-a8f2-e5ab48f08a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60934cec-9d93-4ea4-9e00-ed745313db99", "tag": "42dfed98-3788-4fc6-9076-abcd719b2bc3"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:25.350430 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:35:25.350430 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:35:25.356763 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc535e7d-b4ae-40e4-b4d6-c970e387d0d9 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:25.358085 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-c752e715-380c-4724-b758-ae1c2c20a88f req-5490d057-4141-4adb-a8f2-e5ab48f08a4a service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:25.358818 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc535e7d-b4ae-40e4-b4d6-c970e387d0d9 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:25.359012 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-c752e715-380c-4724-b758-ae1c2c20a88f req-5490d057-4141-4adb-a8f2-e5ab48f08a4a service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:25.360041 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc535e7d-b4ae-40e4-b4d6-c970e387d0d9 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:25.360658 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fc535e7d-b4ae-40e4-b4d6-c970e387d0d9 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:25.376196 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-c752e715-380c-4724-b758-ae1c2c20a88f req-5490d057-4141-4adb-a8f2-e5ab48f08a4a service nova] Creating event network-changed:42dfed98-3788-4fc6-9076-abcd719b2bc3 for instance 60934cec-9d93-4ea4-9e00-ed745313db99 on hv-cinder-82204 Feb 08 17:35:25.389031 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-c752e715-380c-4724-b758-ae1c2c20a88f req-5490d057-4141-4adb-a8f2-e5ab48f08a4a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045188 Feb 08 17:35:25.392797 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 445/868] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:25.426867 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-fc535e7d-b4ae-40e4-b4d6-c970e387d0d9 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089144 Feb 08 17:35:25.427291 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 424/869] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:35:25 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:35:25.521428 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6011d8ab-b1b5-4868-8ef2-b367c62a8023 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:25.522585 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6011d8ab-b1b5-4868-8ef2-b367c62a8023 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:25.533898 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6011d8ab-b1b5-4868-8ef2-b367c62a8023 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:25.534656 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6011d8ab-b1b5-4868-8ef2-b367c62a8023 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:25.535764 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6011d8ab-b1b5-4868-8ef2-b367c62a8023 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:25.536449 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6011d8ab-b1b5-4868-8ef2-b367c62a8023 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:25.756718 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6011d8ab-b1b5-4868-8ef2-b367c62a8023 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:25.770124 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6011d8ab-b1b5-4868-8ef2-b367c62a8023 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1511 microversion: 2.1 time: 0.254232 Feb 08 17:35:25.773217 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 446/870] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:25 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:26.445467 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0592f6a0-42db-4c25-9006-d29c3fc8d407 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:26.447209 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0592f6a0-42db-4c25-9006-d29c3fc8d407 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:26.458599 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0592f6a0-42db-4c25-9006-d29c3fc8d407 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:26.459241 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0592f6a0-42db-4c25-9006-d29c3fc8d407 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:26.461253 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0592f6a0-42db-4c25-9006-d29c3fc8d407 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:26.462064 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0592f6a0-42db-4c25-9006-d29c3fc8d407 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:26.508366 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0592f6a0-42db-4c25-9006-d29c3fc8d407 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070578 Feb 08 17:35:26.508967 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 425/871] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:35:26 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:26.796783 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-79812e52-bbe6-473e-89bf-a3deb16c1d4f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:26.797785 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-79812e52-bbe6-473e-89bf-a3deb16c1d4f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:26.812661 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79812e52-bbe6-473e-89bf-a3deb16c1d4f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:26.813321 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79812e52-bbe6-473e-89bf-a3deb16c1d4f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:26.814455 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79812e52-bbe6-473e-89bf-a3deb16c1d4f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:26.814977 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-79812e52-bbe6-473e-89bf-a3deb16c1d4f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:27.024183 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-79812e52-bbe6-473e-89bf-a3deb16c1d4f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:27.036131 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-79812e52-bbe6-473e-89bf-a3deb16c1d4f tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1511 microversion: 2.1 time: 0.247248 Feb 08 17:35:27.036872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 447/872] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:26 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:27.528489 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d1bf42cf-fc0a-43cc-afca-f4502d62e6ce tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:27.530194 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d1bf42cf-fc0a-43cc-afca-f4502d62e6ce tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:27.544928 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d1bf42cf-fc0a-43cc-afca-f4502d62e6ce tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:27.545865 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d1bf42cf-fc0a-43cc-afca-f4502d62e6ce tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:27.547286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d1bf42cf-fc0a-43cc-afca-f4502d62e6ce tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:27.548086 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d1bf42cf-fc0a-43cc-afca-f4502d62e6ce tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:27.617446 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d1bf42cf-fc0a-43cc-afca-f4502d62e6ce tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097791 Feb 08 17:35:27.618050 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 426/873] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:35:27 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 17:35:27.630972 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fbfa45f4-2112-4b88-a335-05630989ccbf tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:27.631470 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-fbfa45f4-2112-4b88-a335-05630989ccbf tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:27.639100 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fbfa45f4-2112-4b88-a335-05630989ccbf tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:27.640062 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fbfa45f4-2112-4b88-a335-05630989ccbf tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:27.641071 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fbfa45f4-2112-4b88-a335-05630989ccbf tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:27.641899 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fbfa45f4-2112-4b88-a335-05630989ccbf tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:27.659567 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-cca4f6bf-e31a-479d-9bb8-d7a04b4b3a8d req-4fb8352a-d4c2-4e40-8709-76d2b4250b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1c405c-8f1a-49d0-a128-67027dae51ed", "name": "network-vif-deleted", "tag": "777433bc-e1f2-41da-b7c6-8abca55ae19d"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:27.662200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:35:27.662200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:35:27.678895 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-cca4f6bf-e31a-479d-9bb8-d7a04b4b3a8d req-4fb8352a-d4c2-4e40-8709-76d2b4250b2a service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:27.679841 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-cca4f6bf-e31a-479d-9bb8-d7a04b4b3a8d req-4fb8352a-d4c2-4e40-8709-76d2b4250b2a service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:27.696941 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-cca4f6bf-e31a-479d-9bb8-d7a04b4b3a8d req-4fb8352a-d4c2-4e40-8709-76d2b4250b2a service nova] Creating event network-vif-deleted:777433bc-e1f2-41da-b7c6-8abca55ae19d for instance 9e1c405c-8f1a-49d0-a128-67027dae51ed on hv-cinder-82204 Feb 08 17:35:27.703454 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-cca4f6bf-e31a-479d-9bb8-d7a04b4b3a8d req-4fb8352a-d4c2-4e40-8709-76d2b4250b2a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049713 Feb 08 17:35:27.704372 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 427/874] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:27.783985 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-fbfa45f4-2112-4b88-a335-05630989ccbf tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] HTTP exception thrown: Instance 60934cec-9d93-4ea4-9e00-ed745313db99 is not attached to volume 8d8f8f7e-63a2-47e3-a934-d0c0988fcfd2 Feb 08 17:35:27.784984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fbfa45f4-2112-4b88-a335-05630989ccbf tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Returning 404 to user: Instance 60934cec-9d93-4ea4-9e00-ed745313db99 is not attached to volume 8d8f8f7e-63a2-47e3-a934-d0c0988fcfd2 {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:35:27.786616 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-fbfa45f4-2112-4b88-a335-05630989ccbf tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "DELETE /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments/8d8f8f7e-63a2-47e3-a934-d0c0988fcfd2" status: 404 len: 154 microversion: 2.1 time: 0.160119 Feb 08 17:35:27.787665 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 448/875] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:35:27 2022] DELETE /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99/os-volume_attachments/8d8f8f7e-63a2-47e3-a934-d0c0988fcfd2 => generated 154 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:35:28.058372 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-665c4e14-c6a2-437a-992f-c58f899f5176 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:28.059351 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-665c4e14-c6a2-437a-992f-c58f899f5176 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:28.070166 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-665c4e14-c6a2-437a-992f-c58f899f5176 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:28.070335 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-665c4e14-c6a2-437a-992f-c58f899f5176 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:28.071371 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-665c4e14-c6a2-437a-992f-c58f899f5176 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:28.071838 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-665c4e14-c6a2-437a-992f-c58f899f5176 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:28.121645 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-665c4e14-c6a2-437a-992f-c58f899f5176 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:28.122209 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-665c4e14-c6a2-437a-992f-c58f899f5176 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:28.122756 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-665c4e14-c6a2-437a-992f-c58f899f5176 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lazy-loading 'fault' on Instance uuid 9e1c405c-8f1a-49d0-a128-67027dae51ed {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:35:28.178611 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-665c4e14-c6a2-437a-992f-c58f899f5176 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecb87afe54d4389b8177a3570088e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb713ad3e34829a512ab7b068613e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:28.192744 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-665c4e14-c6a2-437a-992f-c58f899f5176 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 200 len: 1307 microversion: 2.1 time: 0.140345 Feb 08 17:35:28.193710 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 428/876] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:28 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 1307 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:35:28.998396 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bdfe99a8-d0cd-429d-bccc-e44801d0d436 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:28.999052 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bdfe99a8-d0cd-429d-bccc-e44801d0d436 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:29.005875 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bdfe99a8-d0cd-429d-bccc-e44801d0d436 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:29.006733 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bdfe99a8-d0cd-429d-bccc-e44801d0d436 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:29.007757 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bdfe99a8-d0cd-429d-bccc-e44801d0d436 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:29.008320 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bdfe99a8-d0cd-429d-bccc-e44801d0d436 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:29.043914 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bdfe99a8-d0cd-429d-bccc-e44801d0d436 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:35:29.175164 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bdfe99a8-d0cd-429d-bccc-e44801d0d436 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "DELETE /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 204 len: 0 microversion: 2.1 time: 0.180273 Feb 08 17:35:29.176458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 449/877] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:35:28 2022] DELETE /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 08 17:35:29.186862 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-17c717f9-62e8-487c-9309-a5fb802caa1f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:29.187906 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-17c717f9-62e8-487c-9309-a5fb802caa1f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:29.198821 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17c717f9-62e8-487c-9309-a5fb802caa1f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:29.199547 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17c717f9-62e8-487c-9309-a5fb802caa1f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:29.200917 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17c717f9-62e8-487c-9309-a5fb802caa1f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:29.201926 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-17c717f9-62e8-487c-9309-a5fb802caa1f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:29.226640 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-eedbfb1a-b7c7-44b6-b636-40b42bec6551 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:29.227690 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-eedbfb1a-b7c7-44b6-b636-40b42bec6551 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] [instance: 9e1c405c-8f1a-49d0-a128-67027dae51ed] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:29.236005 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eedbfb1a-b7c7-44b6-b636-40b42bec6551 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:29.236587 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eedbfb1a-b7c7-44b6-b636-40b42bec6551 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:29.238022 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eedbfb1a-b7c7-44b6-b636-40b42bec6551 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:29.239221 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eedbfb1a-b7c7-44b6-b636-40b42bec6551 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:29.266636 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-eedbfb1a-b7c7-44b6-b636-40b42bec6551 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] HTTP exception thrown: Instance 9e1c405c-8f1a-49d0-a128-67027dae51ed could not be found. Feb 08 17:35:29.267255 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-eedbfb1a-b7c7-44b6-b636-40b42bec6551 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] Returning 404 to user: Instance 9e1c405c-8f1a-49d0-a128-67027dae51ed could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:35:29.268849 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-eedbfb1a-b7c7-44b6-b636-40b42bec6551 tempest-AttachVolumeNegativeTest-1660822341 tempest-AttachVolumeNegativeTest-1660822341-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed" status: 404 len: 111 microversion: 2.1 time: 0.051785 Feb 08 17:35:29.269883 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 450/878] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:29 2022] GET /compute/v2.1/servers/9e1c405c-8f1a-49d0-a128-67027dae51ed => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:35:29.423314 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-17c717f9-62e8-487c-9309-a5fb802caa1f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:29.433548 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-17c717f9-62e8-487c-9309-a5fb802caa1f tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1554 microversion: 2.1 time: 0.252200 Feb 08 17:35:29.434478 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 429/879] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:29 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:30.470100 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d7feff6c-340b-4d6e-bdda-0acc50d1d575 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:30.471352 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d7feff6c-340b-4d6e-bdda-0acc50d1d575 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:30.485953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d7feff6c-340b-4d6e-bdda-0acc50d1d575 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:30.487444 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d7feff6c-340b-4d6e-bdda-0acc50d1d575 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:30.488845 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d7feff6c-340b-4d6e-bdda-0acc50d1d575 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:30.490033 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d7feff6c-340b-4d6e-bdda-0acc50d1d575 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:30.808137 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d7feff6c-340b-4d6e-bdda-0acc50d1d575 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:30.833095 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d7feff6c-340b-4d6e-bdda-0acc50d1d575 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1554 microversion: 2.1 time: 0.370195 Feb 08 17:35:30.834174 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 451/880] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:30 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1554 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:31.867991 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ea4de752-111f-479d-a529-820f39aa6278 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:31.868755 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ea4de752-111f-479d-a529-820f39aa6278 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:31.883136 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ea4de752-111f-479d-a529-820f39aa6278 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:31.883136 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ea4de752-111f-479d-a529-820f39aa6278 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:31.883136 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ea4de752-111f-479d-a529-820f39aa6278 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:31.883136 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ea4de752-111f-479d-a529-820f39aa6278 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:32.160507 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ea4de752-111f-479d-a529-820f39aa6278 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:32.177510 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ea4de752-111f-479d-a529-820f39aa6278 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1554 microversion: 2.1 time: 0.315176 Feb 08 17:35:32.178136 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 430/881] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:31 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1554 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:33.196658 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-bc4c55b4-05ce-4bad-9114-7e15f15f0ba4 req-50fb13da-347d-4c1e-9a7a-fa5067ef3342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60934cec-9d93-4ea4-9e00-ed745313db99", "name": "network-vif-deleted", "tag": "42dfed98-3788-4fc6-9076-abcd719b2bc3"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:33.200256 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:35:33.200256 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:35:33.212583 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1a90b43e-2835-4aed-9eb1-457d4925f576 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:33.216019 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-bc4c55b4-05ce-4bad-9114-7e15f15f0ba4 req-50fb13da-347d-4c1e-9a7a-fa5067ef3342 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:33.216334 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1a90b43e-2835-4aed-9eb1-457d4925f576 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:33.216543 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-bc4c55b4-05ce-4bad-9114-7e15f15f0ba4 req-50fb13da-347d-4c1e-9a7a-fa5067ef3342 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:33.233061 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a90b43e-2835-4aed-9eb1-457d4925f576 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:33.234156 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a90b43e-2835-4aed-9eb1-457d4925f576 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:33.236434 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a90b43e-2835-4aed-9eb1-457d4925f576 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:33.237910 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a90b43e-2835-4aed-9eb1-457d4925f576 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:33.239119 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-bc4c55b4-05ce-4bad-9114-7e15f15f0ba4 req-50fb13da-347d-4c1e-9a7a-fa5067ef3342 service nova] Creating event network-vif-deleted:42dfed98-3788-4fc6-9076-abcd719b2bc3 for instance 60934cec-9d93-4ea4-9e00-ed745313db99 on hv-cinder-82204 Feb 08 17:35:33.249818 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-bc4c55b4-05ce-4bad-9114-7e15f15f0ba4 req-50fb13da-347d-4c1e-9a7a-fa5067ef3342 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059182 Feb 08 17:35:33.251578 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 452/882] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:33.403000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1a90b43e-2835-4aed-9eb1-457d4925f576 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621091c3c9fa42c7b98ec2d2b49d2c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73d5104d66948b984ce1c84170053b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:33.417899 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1a90b43e-2835-4aed-9eb1-457d4925f576 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 200 len: 1512 microversion: 2.1 time: 0.211925 Feb 08 17:35:33.418945 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 431/883] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:33 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:34.436724 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1e314577-5a19-49c4-8ec8-69eaead3e12a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:34.439183 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1e314577-5a19-49c4-8ec8-69eaead3e12a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:34.455730 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1e314577-5a19-49c4-8ec8-69eaead3e12a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:34.456037 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1e314577-5a19-49c4-8ec8-69eaead3e12a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:34.457720 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1e314577-5a19-49c4-8ec8-69eaead3e12a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:34.458581 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1e314577-5a19-49c4-8ec8-69eaead3e12a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:34.471150 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d0976354-a009-4908-aa6c-7e25091345ff tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:34.472198 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d0976354-a009-4908-aa6c-7e25091345ff tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] [instance: 60934cec-9d93-4ea4-9e00-ed745313db99] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:34.489671 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d0976354-a009-4908-aa6c-7e25091345ff tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:34.490627 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d0976354-a009-4908-aa6c-7e25091345ff tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:34.492363 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d0976354-a009-4908-aa6c-7e25091345ff tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:34.493249 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d0976354-a009-4908-aa6c-7e25091345ff tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:34.525592 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-1e314577-5a19-49c4-8ec8-69eaead3e12a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lazy-loading 'flavor' on Instance uuid 9897ad7c-5c82-4c2d-ad35-d99660e7a347 {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:35:34.531267 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-d0976354-a009-4908-aa6c-7e25091345ff tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] HTTP exception thrown: Instance 60934cec-9d93-4ea4-9e00-ed745313db99 could not be found. Feb 08 17:35:34.532020 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d0976354-a009-4908-aa6c-7e25091345ff tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Returning 404 to user: Instance 60934cec-9d93-4ea4-9e00-ed745313db99 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:35:34.533472 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d0976354-a009-4908-aa6c-7e25091345ff tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99" status: 404 len: 111 microversion: 2.1 time: 0.089272 Feb 08 17:35:34.536239 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 432/884] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:34 2022] GET /compute/v2.1/servers/60934cec-9d93-4ea4-9e00-ed745313db99 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:35:34.552166 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-aa2e13a6-496f-49ec-9835-a326b1371825 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] Calling method '.version_select at 0x7fd9f98bb790>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:34.586002 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-aa2e13a6-496f-49ec-9835-a326b1371825 tempest-TestMinimumBasicScenario-732589445 tempest-TestMinimumBasicScenario-732589445-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-586901702" status: 202 len: 0 microversion: 2.1 time: 0.042355 Feb 08 17:35:34.587096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 433/885] 10.222.0.69 () {58 vars in 1268 bytes} [Tue Feb 8 17:35:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-586901702 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 17:35:35.002626 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1e314577-5a19-49c4-8ec8-69eaead3e12a tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "POST /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/action" status: 202 len: 0 microversion: 2.20 time: 0.573904 Feb 08 17:35:35.009787 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 453/886] 10.222.0.69 () {62 vars in 1318 bytes} [Tue Feb 8 17:35:34 2022] POST /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:35:35.021372 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6d332b8c-431b-4dcd-b737-337948aa053f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:35.022299 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6d332b8c-431b-4dcd-b737-337948aa053f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:35.035787 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6d332b8c-431b-4dcd-b737-337948aa053f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:35.036699 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6d332b8c-431b-4dcd-b737-337948aa053f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:35.038993 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6d332b8c-431b-4dcd-b737-337948aa053f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:35.041142 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6d332b8c-431b-4dcd-b737-337948aa053f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:35.344446 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6d332b8c-431b-4dcd-b737-337948aa053f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:35.365429 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6d332b8c-431b-4dcd-b737-337948aa053f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:35.368994 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6d332b8c-431b-4dcd-b737-337948aa053f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:35.371091 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6d332b8c-431b-4dcd-b737-337948aa053f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.358836 Feb 08 17:35:35.372083 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 434/887] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:35 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:35:36.399907 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-40da8207-5fcc-47bc-932e-3bbf5987fa9e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:36.401913 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-40da8207-5fcc-47bc-932e-3bbf5987fa9e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:36.412108 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-40da8207-5fcc-47bc-932e-3bbf5987fa9e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:36.412831 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-40da8207-5fcc-47bc-932e-3bbf5987fa9e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:36.415070 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-40da8207-5fcc-47bc-932e-3bbf5987fa9e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:36.416356 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-40da8207-5fcc-47bc-932e-3bbf5987fa9e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:37.102394 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-40da8207-5fcc-47bc-932e-3bbf5987fa9e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:37.129681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-40da8207-5fcc-47bc-932e-3bbf5987fa9e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:37.134938 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-40da8207-5fcc-47bc-932e-3bbf5987fa9e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:37.138544 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-40da8207-5fcc-47bc-932e-3bbf5987fa9e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.744900 Feb 08 17:35:37.141338 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 454/888] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:36 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:35:38.166628 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-81dfdb43-c611-4db4-8e98-2732fda00a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:38.168571 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-81dfdb43-c611-4db4-8e98-2732fda00a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:38.184000 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-81dfdb43-c611-4db4-8e98-2732fda00a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:38.185740 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-81dfdb43-c611-4db4-8e98-2732fda00a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:38.187536 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-81dfdb43-c611-4db4-8e98-2732fda00a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:38.188486 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-81dfdb43-c611-4db4-8e98-2732fda00a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:38.428973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-81dfdb43-c611-4db4-8e98-2732fda00a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:38.436880 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-81dfdb43-c611-4db4-8e98-2732fda00a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:38.438439 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-81dfdb43-c611-4db4-8e98-2732fda00a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:38.439626 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-81dfdb43-c611-4db4-8e98-2732fda00a81 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.281393 Feb 08 17:35:38.440357 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 435/889] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:38 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:35:39.467782 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3a86ebe5-8043-4918-a490-6c1c5f56fc93 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:39.470395 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3a86ebe5-8043-4918-a490-6c1c5f56fc93 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:39.498208 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3a86ebe5-8043-4918-a490-6c1c5f56fc93 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:39.499452 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3a86ebe5-8043-4918-a490-6c1c5f56fc93 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:39.500937 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3a86ebe5-8043-4918-a490-6c1c5f56fc93 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:39.501907 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3a86ebe5-8043-4918-a490-6c1c5f56fc93 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:39.894564 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3a86ebe5-8043-4918-a490-6c1c5f56fc93 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:39.911599 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3a86ebe5-8043-4918-a490-6c1c5f56fc93 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:39.914241 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3a86ebe5-8043-4918-a490-6c1c5f56fc93 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:39.916402 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3a86ebe5-8043-4918-a490-6c1c5f56fc93 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.459352 Feb 08 17:35:39.917353 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 455/890] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:39 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:35:40.269918 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1007200297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-951021457", "security_groups": [{"name": "tempest-secgroup-smoke-2081424720"}], "networks": [{"uuid": "11f5e39b-3bc1-4031-81b0-0f80211e0497"}], "block_device_mapping_v2": [{"uuid": "dae4c7af-704c-4446-934e-da546c5c9c5c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:40.499666 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.network.neutron [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] validate_networks() for [('11f5e39b-3bc1-4031-81b0-0f80211e0497', None, None, None, None, None)] {{(pid=116479) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:35:40.938285 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8ff8748d-93cd-49b9-a6ec-2dfd0fa78589 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:40.939063 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8ff8748d-93cd-49b9-a6ec-2dfd0fa78589 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:40.946085 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8ff8748d-93cd-49b9-a6ec-2dfd0fa78589 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:40.946811 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8ff8748d-93cd-49b9-a6ec-2dfd0fa78589 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:40.947763 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8ff8748d-93cd-49b9-a6ec-2dfd0fa78589 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:40.948310 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8ff8748d-93cd-49b9-a6ec-2dfd0fa78589 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:41.174320 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8ff8748d-93cd-49b9-a6ec-2dfd0fa78589 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:41.187456 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8ff8748d-93cd-49b9-a6ec-2dfd0fa78589 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:41.189281 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8ff8748d-93cd-49b9-a6ec-2dfd0fa78589 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:41.190064 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8ff8748d-93cd-49b9-a6ec-2dfd0fa78589 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.255567 Feb 08 17:35:41.198815 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 456/891] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:40 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:35:41.290345 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-86712154-38df-4e1b-9ab1-34de08464f84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:41.290844 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-86712154-38df-4e1b-9ab1-34de08464f84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:41.306253 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-86712154-38df-4e1b-9ab1-34de08464f84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:41.306872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-86712154-38df-4e1b-9ab1-34de08464f84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:41.307694 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-86712154-38df-4e1b-9ab1-34de08464f84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:41.308185 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-86712154-38df-4e1b-9ab1-34de08464f84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:41.354539 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-86712154-38df-4e1b-9ab1-34de08464f84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments/b811a964-cf95-4bdf-aaae-be4ac1f336cf" status: 200 len: 194 microversion: 2.1 time: 0.068296 Feb 08 17:35:41.357414 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 457/892] 10.222.0.69 () {58 vars in 1412 bytes} [Tue Feb 8 17:35:41 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments/b811a964-cf95-4bdf-aaae-be4ac1f336cf => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:41.372458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ef0084f1-37d7-494e-a8c8-549824a1f13a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:41.373070 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ef0084f1-37d7-494e-a8c8-549824a1f13a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:41.382663 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ef0084f1-37d7-494e-a8c8-549824a1f13a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:41.383548 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ef0084f1-37d7-494e-a8c8-549824a1f13a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:41.384611 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ef0084f1-37d7-494e-a8c8-549824a1f13a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:41.385326 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ef0084f1-37d7-494e-a8c8-549824a1f13a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:41.523470 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-ef0084f1-37d7-494e-a8c8-549824a1f13a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lazy-loading 'services' on Instance uuid e8af1592-80ef-4b09-b8d6-05880da48fae {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:35:41.564905 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Flavor limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:35:41.565418 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Image limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:35:41.565904 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Flavor pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:35:41.566350 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Image pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:35:41.566776 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:35:41.576929 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:41.577634 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:41.578477 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:41.578918 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:41.601392 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Getting quotas for project 28ccc8eef185498e9ceeef80e17e6481. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:35:41.608655 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Getting quotas for user 8379ee89f3474da488245ea1d34e704a and project 28ccc8eef185498e9ceeef80e17e6481. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:35:41.657355 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ef0084f1-37d7-494e-a8c8-549824a1f13a tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments/b811a964-cf95-4bdf-aaae-be4ac1f336cf" status: 202 len: 0 microversion: 2.1 time: 0.287823 Feb 08 17:35:41.660497 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 458/893] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:35:41 2022] DELETE /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments/b811a964-cf95-4bdf-aaae-be4ac1f336cf => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:35:41.716160 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Going to run 1 instances... {{(pid=116479) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:35:41.732129 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dae4c7af-704c-4446-934e-da546c5c9c5c',volume_size=None,volume_type=None)] {{(pid=116479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:35:42.086754 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3a4c4dc4-50b2-4e6f-93fa-f83f09d7f4cf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.824116 Feb 08 17:35:42.089636 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 436/894] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:35:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:35:42.113230 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5fc4ceaa-c6b3-4ee4-8760-ebcac5e19d58 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:42.115789 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5fc4ceaa-c6b3-4ee4-8760-ebcac5e19d58 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:42.212046 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cda841a3-6f5e-4c8b-89c6-3f861adf3481 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:42.212999 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-cda841a3-6f5e-4c8b-89c6-3f861adf3481 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:42.247006 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cda841a3-6f5e-4c8b-89c6-3f861adf3481 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:42.247868 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cda841a3-6f5e-4c8b-89c6-3f861adf3481 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:42.249423 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cda841a3-6f5e-4c8b-89c6-3f861adf3481 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:42.250112 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cda841a3-6f5e-4c8b-89c6-3f861adf3481 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:42.407373 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-5fc4ceaa-c6b3-4ee4-8760-ebcac5e19d58 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:42.418534 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5fc4ceaa-c6b3-4ee4-8760-ebcac5e19d58 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1088 microversion: 2.1 time: 0.321266 Feb 08 17:35:42.420025 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 459/895] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:42 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1088 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:42.749393 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cda841a3-6f5e-4c8b-89c6-3f861adf3481 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:42.800064 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cda841a3-6f5e-4c8b-89c6-3f861adf3481 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:42.842496 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cda841a3-6f5e-4c8b-89c6-3f861adf3481 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:42.844768 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cda841a3-6f5e-4c8b-89c6-3f861adf3481 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.638669 Feb 08 17:35:42.887529 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 437/896] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:42 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:35:43.439814 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2e44a7ee-ef56-471f-8105-037e47ff9f6d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:43.441648 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2e44a7ee-ef56-471f-8105-037e47ff9f6d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:43.457509 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2e44a7ee-ef56-471f-8105-037e47ff9f6d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:43.457966 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2e44a7ee-ef56-471f-8105-037e47ff9f6d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:43.459000 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2e44a7ee-ef56-471f-8105-037e47ff9f6d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:43.459734 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2e44a7ee-ef56-471f-8105-037e47ff9f6d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:43.541129 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2e44a7ee-ef56-471f-8105-037e47ff9f6d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:43.555799 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2e44a7ee-ef56-471f-8105-037e47ff9f6d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1186 microversion: 2.1 time: 0.120013 Feb 08 17:35:43.557143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 460/897] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:43 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1186 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:43.900887 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-49f0672a-cb1a-4c8f-b30f-426b6f867768 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:43.906237 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-49f0672a-cb1a-4c8f-b30f-426b6f867768 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:43.919492 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-49f0672a-cb1a-4c8f-b30f-426b6f867768 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:43.919659 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-49f0672a-cb1a-4c8f-b30f-426b6f867768 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:43.920914 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-49f0672a-cb1a-4c8f-b30f-426b6f867768 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:43.921432 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-49f0672a-cb1a-4c8f-b30f-426b6f867768 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:44.001240 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-73caf0dd-eb29-4c9c-92bf-5e3932843a64 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:44.001713 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-73caf0dd-eb29-4c9c-92bf-5e3932843a64 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:44.010408 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-73caf0dd-eb29-4c9c-92bf-5e3932843a64 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:44.010875 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-73caf0dd-eb29-4c9c-92bf-5e3932843a64 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:44.012178 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-73caf0dd-eb29-4c9c-92bf-5e3932843a64 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:44.012632 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-73caf0dd-eb29-4c9c-92bf-5e3932843a64 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:44.051240 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-73caf0dd-eb29-4c9c-92bf-5e3932843a64 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments/ceca058c-6e42-40ae-87f3-d7a21f9e9ad2" status: 200 len: 194 microversion: 2.1 time: 0.053879 Feb 08 17:35:44.051947 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 461/898] 10.222.0.69 () {58 vars in 1412 bytes} [Tue Feb 8 17:35:43 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments/ceca058c-6e42-40ae-87f3-d7a21f9e9ad2 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:35:44.069637 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6c01d5b2-00cf-444a-9bfb-bea39da01351 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:44.070143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6c01d5b2-00cf-444a-9bfb-bea39da01351 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:44.078496 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6c01d5b2-00cf-444a-9bfb-bea39da01351 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:44.079227 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6c01d5b2-00cf-444a-9bfb-bea39da01351 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:44.080955 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6c01d5b2-00cf-444a-9bfb-bea39da01351 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:44.081183 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6c01d5b2-00cf-444a-9bfb-bea39da01351 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:44.222951 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-6c01d5b2-00cf-444a-9bfb-bea39da01351 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lazy-loading 'services' on Instance uuid e8af1592-80ef-4b09-b8d6-05880da48fae {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:35:44.348012 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6c01d5b2-00cf-444a-9bfb-bea39da01351 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments/ceca058c-6e42-40ae-87f3-d7a21f9e9ad2" status: 202 len: 0 microversion: 2.1 time: 0.282907 Feb 08 17:35:44.349902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 462/899] 10.222.0.69 () {58 vars in 1415 bytes} [Tue Feb 8 17:35:44 2022] DELETE /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments/ceca058c-6e42-40ae-87f3-d7a21f9e9ad2 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:35:44.405732 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-49f0672a-cb1a-4c8f-b30f-426b6f867768 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:44.424853 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-49f0672a-cb1a-4c8f-b30f-426b6f867768 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:44.429545 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-49f0672a-cb1a-4c8f-b30f-426b6f867768 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:44.431181 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-49f0672a-cb1a-4c8f-b30f-426b6f867768 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.543368 Feb 08 17:35:44.432220 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 438/900] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:43 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:35:44.578325 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9fc8cf51-a5b0-4421-b251-2b30da4857d9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:44.579243 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9fc8cf51-a5b0-4421-b251-2b30da4857d9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:44.587741 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fc8cf51-a5b0-4421-b251-2b30da4857d9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:44.588620 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fc8cf51-a5b0-4421-b251-2b30da4857d9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:44.590363 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fc8cf51-a5b0-4421-b251-2b30da4857d9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:44.591143 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9fc8cf51-a5b0-4421-b251-2b30da4857d9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:44.676019 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9fc8cf51-a5b0-4421-b251-2b30da4857d9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:44.689090 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9fc8cf51-a5b0-4421-b251-2b30da4857d9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1204 microversion: 2.1 time: 0.116743 Feb 08 17:35:44.690122 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 463/901] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:44 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1204 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:45.459045 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b614f1af-4e2b-4ede-8a64-2aad8ba0e83f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:45.462948 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b614f1af-4e2b-4ede-8a64-2aad8ba0e83f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:45.479508 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b614f1af-4e2b-4ede-8a64-2aad8ba0e83f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:45.481205 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b614f1af-4e2b-4ede-8a64-2aad8ba0e83f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:45.483585 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b614f1af-4e2b-4ede-8a64-2aad8ba0e83f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:45.484768 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b614f1af-4e2b-4ede-8a64-2aad8ba0e83f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:45.722482 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-49961d0d-f794-42de-a2c1-9b3e0a27497e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:45.726114 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-49961d0d-f794-42de-a2c1-9b3e0a27497e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:45.746125 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-49961d0d-f794-42de-a2c1-9b3e0a27497e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:45.747570 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-49961d0d-f794-42de-a2c1-9b3e0a27497e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:45.749873 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-49961d0d-f794-42de-a2c1-9b3e0a27497e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:45.750923 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-49961d0d-f794-42de-a2c1-9b3e0a27497e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:45.922077 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-49961d0d-f794-42de-a2c1-9b3e0a27497e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:45.927381 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b614f1af-4e2b-4ede-8a64-2aad8ba0e83f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:45.943999 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-49961d0d-f794-42de-a2c1-9b3e0a27497e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1204 microversion: 2.1 time: 0.228373 Feb 08 17:35:45.957917 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b614f1af-4e2b-4ede-8a64-2aad8ba0e83f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:45.961654 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b614f1af-4e2b-4ede-8a64-2aad8ba0e83f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:45.962364 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 464/902] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:45 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1204 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:45.963586 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b614f1af-4e2b-4ede-8a64-2aad8ba0e83f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.515370 Feb 08 17:35:45.964276 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 439/903] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:45 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:35:46.974496 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1d31a848-2ed2-40b3-8363-4833cad0617d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:46.976197 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1d31a848-2ed2-40b3-8363-4833cad0617d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:46.994326 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-73eba1e0-d799-47f3-9242-3a501ad5a2f1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:46.997330 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-73eba1e0-d799-47f3-9242-3a501ad5a2f1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:46.998213 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d31a848-2ed2-40b3-8363-4833cad0617d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:46.999265 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d31a848-2ed2-40b3-8363-4833cad0617d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:47.000815 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d31a848-2ed2-40b3-8363-4833cad0617d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:47.001792 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d31a848-2ed2-40b3-8363-4833cad0617d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:47.021110 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-73eba1e0-d799-47f3-9242-3a501ad5a2f1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:47.021999 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-73eba1e0-d799-47f3-9242-3a501ad5a2f1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:47.027012 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-73eba1e0-d799-47f3-9242-3a501ad5a2f1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:47.028006 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-73eba1e0-d799-47f3-9242-3a501ad5a2f1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:47.488975 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-73eba1e0-d799-47f3-9242-3a501ad5a2f1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:47.503062 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-73eba1e0-d799-47f3-9242-3a501ad5a2f1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:47.507015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-73eba1e0-d799-47f3-9242-3a501ad5a2f1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:47.512739 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-73eba1e0-d799-47f3-9242-3a501ad5a2f1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.523557 Feb 08 17:35:47.522681 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 440/904] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:46 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:35:47.788620 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1d31a848-2ed2-40b3-8363-4833cad0617d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:47.802091 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1d31a848-2ed2-40b3-8363-4833cad0617d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1272 microversion: 2.1 time: 0.837152 Feb 08 17:35:47.803896 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 465/905] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:46 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1272 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:48.544109 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-98b31082-9495-4a22-b816-d0a7d252cf0c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:48.548103 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-98b31082-9495-4a22-b816-d0a7d252cf0c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:48.582524 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-98b31082-9495-4a22-b816-d0a7d252cf0c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:48.586233 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-98b31082-9495-4a22-b816-d0a7d252cf0c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:48.588787 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-98b31082-9495-4a22-b816-d0a7d252cf0c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:48.593200 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-98b31082-9495-4a22-b816-d0a7d252cf0c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:48.837823 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c4ca77fb-35bc-439c-b1e7-736eba2eaf8d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:48.838981 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c4ca77fb-35bc-439c-b1e7-736eba2eaf8d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:48.859881 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c4ca77fb-35bc-439c-b1e7-736eba2eaf8d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:48.861294 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c4ca77fb-35bc-439c-b1e7-736eba2eaf8d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:48.863455 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c4ca77fb-35bc-439c-b1e7-736eba2eaf8d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:48.864849 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c4ca77fb-35bc-439c-b1e7-736eba2eaf8d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:49.190376 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c4ca77fb-35bc-439c-b1e7-736eba2eaf8d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:49.203178 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c4ca77fb-35bc-439c-b1e7-736eba2eaf8d tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.373598 Feb 08 17:35:49.204007 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 466/906] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:48 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:49.324212 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-98b31082-9495-4a22-b816-d0a7d252cf0c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:49.338442 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-98b31082-9495-4a22-b816-d0a7d252cf0c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:49.340856 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-98b31082-9495-4a22-b816-d0a7d252cf0c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:49.342184 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-98b31082-9495-4a22-b816-d0a7d252cf0c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.807274 Feb 08 17:35:49.342864 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 441/907] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:48 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:35:49.483956 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-841c8331-a2c3-4737-ad5c-4f61ba1013c5 req-f8e7931b-ac6f-445c-b033-783575e557aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8692ef30-50d2-43bc-84ad-1d7308a694cf", "tag": "cf060131-592b-49f3-bed4-02a89d544e1f"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:49.487915 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:35:49.487915 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:35:49.510855 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-841c8331-a2c3-4737-ad5c-4f61ba1013c5 req-f8e7931b-ac6f-445c-b033-783575e557aa service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:49.511580 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-841c8331-a2c3-4737-ad5c-4f61ba1013c5 req-f8e7931b-ac6f-445c-b033-783575e557aa service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:49.538074 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-841c8331-a2c3-4737-ad5c-4f61ba1013c5 req-f8e7931b-ac6f-445c-b033-783575e557aa service nova] Creating event network-changed:cf060131-592b-49f3-bed4-02a89d544e1f for instance 8692ef30-50d2-43bc-84ad-1d7308a694cf on hv-cinder-82204 Feb 08 17:35:49.546381 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-841c8331-a2c3-4737-ad5c-4f61ba1013c5 req-f8e7931b-ac6f-445c-b033-783575e557aa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079769 Feb 08 17:35:49.549665 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 467/908] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:50.230469 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f225da5c-2179-468f-87b5-bfd278db8b05 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:50.231403 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f225da5c-2179-468f-87b5-bfd278db8b05 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:50.239594 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c0840059-2edb-49a8-90eb-026371e5e109 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:50.246590 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f225da5c-2179-468f-87b5-bfd278db8b05 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:50.247100 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f225da5c-2179-468f-87b5-bfd278db8b05 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:50.249337 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c0840059-2edb-49a8-90eb-026371e5e109 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:50.251037 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f225da5c-2179-468f-87b5-bfd278db8b05 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:50.251827 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f225da5c-2179-468f-87b5-bfd278db8b05 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:50.265185 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c0840059-2edb-49a8-90eb-026371e5e109 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:50.265654 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c0840059-2edb-49a8-90eb-026371e5e109 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:50.266499 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c0840059-2edb-49a8-90eb-026371e5e109 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:50.266948 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c0840059-2edb-49a8-90eb-026371e5e109 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:50.317943 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c0840059-2edb-49a8-90eb-026371e5e109 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085847 Feb 08 17:35:50.325579 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 468/909] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:35:50 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 08 17:35:50.371994 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7d8a539a-a030-4c90-a624-df163c2ca9ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:50.373400 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7d8a539a-a030-4c90-a624-df163c2ca9ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:50.397238 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d8a539a-a030-4c90-a624-df163c2ca9ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:50.397702 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d8a539a-a030-4c90-a624-df163c2ca9ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:50.405912 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d8a539a-a030-4c90-a624-df163c2ca9ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:50.414406 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d8a539a-a030-4c90-a624-df163c2ca9ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:50.703321 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-f225da5c-2179-468f-87b5-bfd278db8b05 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:50.720564 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f225da5c-2179-468f-87b5-bfd278db8b05 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.496341 Feb 08 17:35:50.722008 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 442/910] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:50 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:35:50.727866 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-bdb75652-a5e0-44a5-86de-6173e7aac49d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:50.729119 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-bdb75652-a5e0-44a5-86de-6173e7aac49d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:50.735771 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bdb75652-a5e0-44a5-86de-6173e7aac49d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:50.736570 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bdb75652-a5e0-44a5-86de-6173e7aac49d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:50.738691 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bdb75652-a5e0-44a5-86de-6173e7aac49d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:50.739822 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-bdb75652-a5e0-44a5-86de-6173e7aac49d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:50.796813 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-bdb75652-a5e0-44a5-86de-6173e7aac49d tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073441 Feb 08 17:35:50.798111 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 443/911] 10.222.0.69 () {58 vars in 1301 bytes} [Tue Feb 8 17:35:50 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 17:35:50.837828 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7d8a539a-a030-4c90-a624-df163c2ca9ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:50.851599 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7d8a539a-a030-4c90-a624-df163c2ca9ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:50.853934 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7d8a539a-a030-4c90-a624-df163c2ca9ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:50.855458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7d8a539a-a030-4c90-a624-df163c2ca9ad tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.491287 Feb 08 17:35:50.856589 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 469/912] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:50 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:35:50.909285 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-842cb030-f90d-4dcf-9599-384e88c722c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:50.910025 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-842cb030-f90d-4dcf-9599-384e88c722c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:50.917320 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-842cb030-f90d-4dcf-9599-384e88c722c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:50.917768 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-842cb030-f90d-4dcf-9599-384e88c722c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:50.918563 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-842cb030-f90d-4dcf-9599-384e88c722c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:50.918984 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-842cb030-f90d-4dcf-9599-384e88c722c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:50.955496 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-842cb030-f90d-4dcf-9599-384e88c722c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Going to try to terminate instance {{(pid=116479) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:35:51.068213 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-842cb030-f90d-4dcf-9599-384e88c722c0 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 204 len: 0 microversion: 2.1 time: 0.165684 Feb 08 17:35:51.069820 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 444/913] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:35:50 2022] DELETE /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:35:51.081276 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7c61a5d9-2d39-4e6b-a1eb-5fa8349774ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:51.081805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7c61a5d9-2d39-4e6b-a1eb-5fa8349774ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:51.089646 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c61a5d9-2d39-4e6b-a1eb-5fa8349774ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:51.090108 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c61a5d9-2d39-4e6b-a1eb-5fa8349774ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:51.091272 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c61a5d9-2d39-4e6b-a1eb-5fa8349774ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:51.091495 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7c61a5d9-2d39-4e6b-a1eb-5fa8349774ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:51.293903 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7c61a5d9-2d39-4e6b-a1eb-5fa8349774ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:51.309772 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7c61a5d9-2d39-4e6b-a1eb-5fa8349774ab tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1671 microversion: 2.1 time: 0.232038 Feb 08 17:35:51.310580 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 470/914] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:51 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1671 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:35:51.774997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-892171e8-b97a-40d2-8460-f9fe0e15032f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:51.776224 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-892171e8-b97a-40d2-8460-f9fe0e15032f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:51.787100 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-892171e8-b97a-40d2-8460-f9fe0e15032f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:51.787100 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-892171e8-b97a-40d2-8460-f9fe0e15032f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:51.788415 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-892171e8-b97a-40d2-8460-f9fe0e15032f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:51.788955 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-892171e8-b97a-40d2-8460-f9fe0e15032f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:51.894482 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4efd9a89-4857-4794-b6ca-88c5bb9cab32 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:51.901820 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4efd9a89-4857-4794-b6ca-88c5bb9cab32 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:51.910763 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4efd9a89-4857-4794-b6ca-88c5bb9cab32 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:51.911652 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4efd9a89-4857-4794-b6ca-88c5bb9cab32 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:51.912793 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4efd9a89-4857-4794-b6ca-88c5bb9cab32 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:51.915244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4efd9a89-4857-4794-b6ca-88c5bb9cab32 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:52.019357 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-892171e8-b97a-40d2-8460-f9fe0e15032f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:52.032530 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-892171e8-b97a-40d2-8460-f9fe0e15032f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.264618 Feb 08 17:35:52.049769 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 445/915] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:51 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:52.197185 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4efd9a89-4857-4794-b6ca-88c5bb9cab32 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:52.211424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4efd9a89-4857-4794-b6ca-88c5bb9cab32 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:52.214724 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4efd9a89-4857-4794-b6ca-88c5bb9cab32 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:52.216950 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4efd9a89-4857-4794-b6ca-88c5bb9cab32 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.326627 Feb 08 17:35:52.217978 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 471/916] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:51 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:35:52.338880 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d1c56976-d3d4-491b-a556-6a03703f91cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:52.340054 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d1c56976-d3d4-491b-a556-6a03703f91cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:52.352721 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d1c56976-d3d4-491b-a556-6a03703f91cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:52.353429 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d1c56976-d3d4-491b-a556-6a03703f91cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:52.354920 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d1c56976-d3d4-491b-a556-6a03703f91cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:52.355718 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d1c56976-d3d4-491b-a556-6a03703f91cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:52.616204 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d1c56976-d3d4-491b-a556-6a03703f91cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:52.630299 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d1c56976-d3d4-491b-a556-6a03703f91cb tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1671 microversion: 2.1 time: 0.298163 Feb 08 17:35:52.632295 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 446/917] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:52 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1671 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:53.061670 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-0f54853a-7b2d-47dd-88d5-cad48c625fd7 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:53.062312 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-0f54853a-7b2d-47dd-88d5-cad48c625fd7 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:53.072766 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0f54853a-7b2d-47dd-88d5-cad48c625fd7 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:53.073362 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0f54853a-7b2d-47dd-88d5-cad48c625fd7 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:53.074844 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0f54853a-7b2d-47dd-88d5-cad48c625fd7 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:53.075512 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-0f54853a-7b2d-47dd-88d5-cad48c625fd7 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:53.252390 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-30c1f657-c102-4771-9812-4cc83a29509d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:53.254185 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-30c1f657-c102-4771-9812-4cc83a29509d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:53.267657 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-30c1f657-c102-4771-9812-4cc83a29509d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:53.268521 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-30c1f657-c102-4771-9812-4cc83a29509d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:53.270193 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-30c1f657-c102-4771-9812-4cc83a29509d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:53.271386 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-30c1f657-c102-4771-9812-4cc83a29509d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:53.294602 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-0f54853a-7b2d-47dd-88d5-cad48c625fd7 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:53.305716 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-0f54853a-7b2d-47dd-88d5-cad48c625fd7 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.248844 Feb 08 17:35:53.306408 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 472/918] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:53 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:35:53.508581 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-30c1f657-c102-4771-9812-4cc83a29509d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:53.520539 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-30c1f657-c102-4771-9812-4cc83a29509d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:53.523243 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-30c1f657-c102-4771-9812-4cc83a29509d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:53.525456 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-30c1f657-c102-4771-9812-4cc83a29509d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1742 microversion: 2.20 time: 0.281815 Feb 08 17:35:53.526174 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 447/919] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:53 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1742 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:35:53.658037 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-25cdde54-f08c-4b16-be5b-e5e9f84e60a6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:53.659402 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-25cdde54-f08c-4b16-be5b-e5e9f84e60a6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:53.671951 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25cdde54-f08c-4b16-be5b-e5e9f84e60a6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:53.673193 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25cdde54-f08c-4b16-be5b-e5e9f84e60a6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:53.674750 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25cdde54-f08c-4b16-be5b-e5e9f84e60a6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:53.675747 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25cdde54-f08c-4b16-be5b-e5e9f84e60a6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:54.004113 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-25cdde54-f08c-4b16-be5b-e5e9f84e60a6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:54.019531 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-25cdde54-f08c-4b16-be5b-e5e9f84e60a6 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1671 microversion: 2.1 time: 0.369426 Feb 08 17:35:54.020670 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 473/920] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:53 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1671 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:35:54.331751 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-8d5dd04b-2f52-48de-8224-88d2f1349468 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:54.332992 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-8d5dd04b-2f52-48de-8224-88d2f1349468 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:54.341485 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d5dd04b-2f52-48de-8224-88d2f1349468 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:54.342096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d5dd04b-2f52-48de-8224-88d2f1349468 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:54.343044 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d5dd04b-2f52-48de-8224-88d2f1349468 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:54.343690 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-8d5dd04b-2f52-48de-8224-88d2f1349468 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:54.557758 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2b3dee61-c7b4-4196-886c-7675f712786c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:54.558566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2b3dee61-c7b4-4196-886c-7675f712786c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:54.566818 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b3dee61-c7b4-4196-886c-7675f712786c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:54.567622 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b3dee61-c7b4-4196-886c-7675f712786c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:54.568565 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b3dee61-c7b4-4196-886c-7675f712786c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:54.569201 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b3dee61-c7b4-4196-886c-7675f712786c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:54.712093 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-8d5dd04b-2f52-48de-8224-88d2f1349468 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:54.725520 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-8d5dd04b-2f52-48de-8224-88d2f1349468 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.400390 Feb 08 17:35:54.727170 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 448/921] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:54 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:54.788407 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2b3dee61-c7b4-4196-886c-7675f712786c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:54.809109 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2b3dee61-c7b4-4196-886c-7675f712786c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:54.812664 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2b3dee61-c7b4-4196-886c-7675f712786c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:54.815222 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2b3dee61-c7b4-4196-886c-7675f712786c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1742 microversion: 2.20 time: 0.262053 Feb 08 17:35:54.817029 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 474/922] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:54 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1742 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:35:55.048299 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1c37d121-f503-40ec-a21a-4bbfb89007ec tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:55.049366 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1c37d121-f503-40ec-a21a-4bbfb89007ec tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:55.085215 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1c37d121-f503-40ec-a21a-4bbfb89007ec tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:55.086259 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1c37d121-f503-40ec-a21a-4bbfb89007ec tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:55.087619 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1c37d121-f503-40ec-a21a-4bbfb89007ec tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:55.088227 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1c37d121-f503-40ec-a21a-4bbfb89007ec tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:55.234253 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1c37d121-f503-40ec-a21a-4bbfb89007ec tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:55.248326 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1c37d121-f503-40ec-a21a-4bbfb89007ec tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1605 microversion: 2.1 time: 0.208726 Feb 08 17:35:55.248948 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 449/923] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:55 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:55.691509 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-dfbcf94d-5e8f-42d6-a5ca-670b1220c25a req-8775fcaa-61f0-494e-abe1-d4fb3c98e546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8af1592-80ef-4b09-b8d6-05880da48fae", "name": "network-vif-deleted", "tag": "0e5f8222-7e85-4961-a7e7-946aa0f2ff02"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:55.695495 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:35:55.695495 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:35:55.716564 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-dfbcf94d-5e8f-42d6-a5ca-670b1220c25a req-8775fcaa-61f0-494e-abe1-d4fb3c98e546 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:55.721151 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-dfbcf94d-5e8f-42d6-a5ca-670b1220c25a req-8775fcaa-61f0-494e-abe1-d4fb3c98e546 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:55.753924 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-15d5b841-21da-4c2b-9537-bebafd01a697 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:55.754764 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-15d5b841-21da-4c2b-9537-bebafd01a697 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:55.759629 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-dfbcf94d-5e8f-42d6-a5ca-670b1220c25a req-8775fcaa-61f0-494e-abe1-d4fb3c98e546 service nova] Creating event network-vif-deleted:0e5f8222-7e85-4961-a7e7-946aa0f2ff02 for instance e8af1592-80ef-4b09-b8d6-05880da48fae on hv-cinder-82204 Feb 08 17:35:55.771396 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15d5b841-21da-4c2b-9537-bebafd01a697 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:55.771966 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15d5b841-21da-4c2b-9537-bebafd01a697 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:55.772821 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15d5b841-21da-4c2b-9537-bebafd01a697 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:55.773300 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-15d5b841-21da-4c2b-9537-bebafd01a697 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:55.778568 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-dfbcf94d-5e8f-42d6-a5ca-670b1220c25a req-8775fcaa-61f0-494e-abe1-d4fb3c98e546 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088598 Feb 08 17:35:55.782373 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 475/924] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:35:55.840361 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fe246b9d-2633-46aa-8402-a4561c8ddd05 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:55.841086 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-fe246b9d-2633-46aa-8402-a4561c8ddd05 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:55.850611 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fe246b9d-2633-46aa-8402-a4561c8ddd05 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:55.851391 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fe246b9d-2633-46aa-8402-a4561c8ddd05 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:55.853336 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fe246b9d-2633-46aa-8402-a4561c8ddd05 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:55.854018 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-fe246b9d-2633-46aa-8402-a4561c8ddd05 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:56.245858 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-fe246b9d-2633-46aa-8402-a4561c8ddd05 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:56.276968 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-fe246b9d-2633-46aa-8402-a4561c8ddd05 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:56.280093 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-fe246b9d-2633-46aa-8402-a4561c8ddd05 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:56.282058 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-fe246b9d-2633-46aa-8402-a4561c8ddd05 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.447083 Feb 08 17:35:56.283575 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 476/925] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:55 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:35:56.290777 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c0c32337-a401-4178-b5e2-19556fcf92ca tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:56.291807 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c0c32337-a401-4178-b5e2-19556fcf92ca tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:56.292651 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-15d5b841-21da-4c2b-9537-bebafd01a697 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:56.302545 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c0c32337-a401-4178-b5e2-19556fcf92ca tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:56.303475 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c0c32337-a401-4178-b5e2-19556fcf92ca tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:56.304823 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c0c32337-a401-4178-b5e2-19556fcf92ca tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:56.305659 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c0c32337-a401-4178-b5e2-19556fcf92ca tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:56.313483 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-15d5b841-21da-4c2b-9537-bebafd01a697 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.564709 Feb 08 17:35:56.314504 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 450/926] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:55 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:35:56.380797 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c0c32337-a401-4178-b5e2-19556fcf92ca tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:56.381862 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c0c32337-a401-4178-b5e2-19556fcf92ca tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:56.382568 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.objects.instance [None req-c0c32337-a401-4178-b5e2-19556fcf92ca tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lazy-loading 'fault' on Instance uuid e8af1592-80ef-4b09-b8d6-05880da48fae {{(pid=116480) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:35:56.582078 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c0c32337-a401-4178-b5e2-19556fcf92ca tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0970b8e8ce4ef5853e58cfdd797ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fedeb21bf7b4056b1737c6e7ddc2d2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:56.590923 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c0c32337-a401-4178-b5e2-19556fcf92ca tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 200 len: 1328 microversion: 2.1 time: 0.305798 Feb 08 17:35:56.591513 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 477/927] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:56 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 1328 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:35:57.328905 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5aab94ac-65dd-4917-9a83-b4b3a3314312 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:57.331864 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5aab94ac-65dd-4917-9a83-b4b3a3314312 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:57.332643 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-36b86c2e-6270-48e6-8064-899d3fb334e9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:57.333515 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-36b86c2e-6270-48e6-8064-899d3fb334e9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:57.344072 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36b86c2e-6270-48e6-8064-899d3fb334e9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:57.344520 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36b86c2e-6270-48e6-8064-899d3fb334e9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:57.349205 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36b86c2e-6270-48e6-8064-899d3fb334e9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:57.349954 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5aab94ac-65dd-4917-9a83-b4b3a3314312 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:57.351296 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5aab94ac-65dd-4917-9a83-b4b3a3314312 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:57.354042 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5aab94ac-65dd-4917-9a83-b4b3a3314312 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:57.355782 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5aab94ac-65dd-4917-9a83-b4b3a3314312 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:57.357270 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-36b86c2e-6270-48e6-8064-899d3fb334e9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:57.701912 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-36b86c2e-6270-48e6-8064-899d3fb334e9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:57.706752 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5aab94ac-65dd-4917-9a83-b4b3a3314312 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:57.717710 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5aab94ac-65dd-4917-9a83-b4b3a3314312 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:57.719550 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5aab94ac-65dd-4917-9a83-b4b3a3314312 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:57.721290 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5aab94ac-65dd-4917-9a83-b4b3a3314312 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.404066 Feb 08 17:35:57.722066 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 451/928] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:57 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:35:57.724369 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-36b86c2e-6270-48e6-8064-899d3fb334e9 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.394853 Feb 08 17:35:57.725672 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 478/929] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:57 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:35:57.734528 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3aa723e5-dda5-4794-bbf0-bcc07b595e84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:57.741139 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-3aa723e5-dda5-4794-bbf0-bcc07b595e84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:57.749570 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3aa723e5-dda5-4794-bbf0-bcc07b595e84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:57.750438 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3aa723e5-dda5-4794-bbf0-bcc07b595e84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:57.751998 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3aa723e5-dda5-4794-bbf0-bcc07b595e84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:57.752750 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-3aa723e5-dda5-4794-bbf0-bcc07b595e84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:57.806334 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-d644120a-1d6b-404f-9ac1-42294f30cffd req-e842ca8f-0002-42e2-86ae-31848c4e3eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9897ad7c-5c82-4c2d-ad35-d99660e7a347", "name": "network-vif-plugged", "status": "completed", "tag": "a4c518af-c3fe-4c2a-bf7f-55f78233f5e9"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:35:57.814501 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:35:57.814501 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:35:57.819830 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-3aa723e5-dda5-4794-bbf0-bcc07b595e84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] HTTP exception thrown: Instance e8af1592-80ef-4b09-b8d6-05880da48fae could not be found. Feb 08 17:35:57.821014 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-3aa723e5-dda5-4794-bbf0-bcc07b595e84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Returning 404 to user: Instance e8af1592-80ef-4b09-b8d6-05880da48fae could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:35:57.822741 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-3aa723e5-dda5-4794-bbf0-bcc07b595e84 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 404 len: 111 microversion: 2.1 time: 0.098726 Feb 08 17:35:57.824407 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 452/930] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:57 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:35:57.837872 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ae78cfac-5f07-4746-b919-aff3c391a75b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '.version_select at 0x7fd9f9862310>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:57.848992 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-d644120a-1d6b-404f-9ac1-42294f30cffd req-e842ca8f-0002-42e2-86ae-31848c4e3eec service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:57.858534 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-d644120a-1d6b-404f-9ac1-42294f30cffd req-e842ca8f-0002-42e2-86ae-31848c4e3eec service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:57.870480 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ae78cfac-5f07-4746-b919-aff3c391a75b tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1736230992" status: 202 len: 0 microversion: 2.1 time: 0.039427 Feb 08 17:35:57.871594 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 453/931] 10.222.0.69 () {58 vars in 1220 bytes} [Tue Feb 8 17:35:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1736230992 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 17:35:57.902263 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-d644120a-1d6b-404f-9ac1-42294f30cffd req-e842ca8f-0002-42e2-86ae-31848c4e3eec service nova] Creating event network-vif-plugged:a4c518af-c3fe-4c2a-bf7f-55f78233f5e9 for instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 on hv-cinder-82204 Feb 08 17:35:57.934750 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-d644120a-1d6b-404f-9ac1-42294f30cffd req-e842ca8f-0002-42e2-86ae-31848c4e3eec service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135777 Feb 08 17:35:57.935996 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 479/932] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:35:58.752027 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b7754b05-c918-476d-a7cc-3bf5f7a58a91 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:58.753102 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b7754b05-c918-476d-a7cc-3bf5f7a58a91 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:58.754820 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-997f5454-5031-4ae3-b5f0-ae6380b7486c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:35:58.756097 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-997f5454-5031-4ae3-b5f0-ae6380b7486c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:35:58.767168 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-997f5454-5031-4ae3-b5f0-ae6380b7486c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:58.771702 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-997f5454-5031-4ae3-b5f0-ae6380b7486c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:58.773191 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-997f5454-5031-4ae3-b5f0-ae6380b7486c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:58.773901 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-997f5454-5031-4ae3-b5f0-ae6380b7486c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:58.774186 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b7754b05-c918-476d-a7cc-3bf5f7a58a91 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:58.776674 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b7754b05-c918-476d-a7cc-3bf5f7a58a91 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:58.779266 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b7754b05-c918-476d-a7cc-3bf5f7a58a91 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:35:58.780309 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b7754b05-c918-476d-a7cc-3bf5f7a58a91 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:35:59.184631 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b7754b05-c918-476d-a7cc-3bf5f7a58a91 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:59.198822 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b7754b05-c918-476d-a7cc-3bf5f7a58a91 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:59.203250 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b7754b05-c918-476d-a7cc-3bf5f7a58a91 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:59.210503 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-997f5454-5031-4ae3-b5f0-ae6380b7486c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:35:59.212377 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b7754b05-c918-476d-a7cc-3bf5f7a58a91 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.469916 Feb 08 17:35:59.213715 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 454/933] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:35:58 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:35:59.271497 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-997f5454-5031-4ae3-b5f0-ae6380b7486c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.516984 Feb 08 17:35:59.275310 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 480/934] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:35:58 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:36:00.249145 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5be9a85d-523a-4b95-94bc-285db75f286e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:00.249871 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5be9a85d-523a-4b95-94bc-285db75f286e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:00.261640 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5be9a85d-523a-4b95-94bc-285db75f286e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:00.266690 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5be9a85d-523a-4b95-94bc-285db75f286e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:00.270538 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5be9a85d-523a-4b95-94bc-285db75f286e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:00.273592 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5be9a85d-523a-4b95-94bc-285db75f286e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:00.300588 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1d8d602a-56f4-49b4-a5e2-a72e8560a986 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:00.301494 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1d8d602a-56f4-49b4-a5e2-a72e8560a986 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:00.315314 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d8d602a-56f4-49b4-a5e2-a72e8560a986 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:00.315762 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d8d602a-56f4-49b4-a5e2-a72e8560a986 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:00.322324 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d8d602a-56f4-49b4-a5e2-a72e8560a986 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:00.323007 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1d8d602a-56f4-49b4-a5e2-a72e8560a986 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:00.630986 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5be9a85d-523a-4b95-94bc-285db75f286e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:00.643510 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5be9a85d-523a-4b95-94bc-285db75f286e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:00.651724 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5be9a85d-523a-4b95-94bc-285db75f286e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:00.652937 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5be9a85d-523a-4b95-94bc-285db75f286e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.408120 Feb 08 17:36:00.659141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 455/935] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:00 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:00.690507 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1d8d602a-56f4-49b4-a5e2-a72e8560a986 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:00.706810 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1d8d602a-56f4-49b4-a5e2-a72e8560a986 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.415840 Feb 08 17:36:00.733262 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 481/936] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:36:00 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:36:01.684507 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2283d9a0-4dce-41dc-82db-27177f13c55c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:01.686445 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2283d9a0-4dce-41dc-82db-27177f13c55c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:01.702910 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2283d9a0-4dce-41dc-82db-27177f13c55c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:01.704015 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2283d9a0-4dce-41dc-82db-27177f13c55c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:01.705572 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2283d9a0-4dce-41dc-82db-27177f13c55c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:01.706603 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2283d9a0-4dce-41dc-82db-27177f13c55c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:01.744173 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-19c83b0a-0ee0-4aae-ae02-aa50cac0660f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:01.745349 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-19c83b0a-0ee0-4aae-ae02-aa50cac0660f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:01.754306 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-19c83b0a-0ee0-4aae-ae02-aa50cac0660f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:01.761227 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-19c83b0a-0ee0-4aae-ae02-aa50cac0660f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:01.765440 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-19c83b0a-0ee0-4aae-ae02-aa50cac0660f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:01.766344 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-19c83b0a-0ee0-4aae-ae02-aa50cac0660f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:02.066538 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2283d9a0-4dce-41dc-82db-27177f13c55c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:02.096743 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2283d9a0-4dce-41dc-82db-27177f13c55c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:02.098342 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2283d9a0-4dce-41dc-82db-27177f13c55c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:02.099539 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2283d9a0-4dce-41dc-82db-27177f13c55c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.426600 Feb 08 17:36:02.113237 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 456/937] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:01 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:02.119433 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-02295061-59b5-4c06-9afb-d813fb0b8026 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:02.119619 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-19c83b0a-0ee0-4aae-ae02-aa50cac0660f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:02.120411 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-02295061-59b5-4c06-9afb-d813fb0b8026 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:02.127896 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02295061-59b5-4c06-9afb-d813fb0b8026 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:02.128599 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02295061-59b5-4c06-9afb-d813fb0b8026 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:02.129676 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02295061-59b5-4c06-9afb-d813fb0b8026 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:02.130337 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-02295061-59b5-4c06-9afb-d813fb0b8026 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:02.134362 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-19c83b0a-0ee0-4aae-ae02-aa50cac0660f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.398314 Feb 08 17:36:02.135999 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 482/938] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:36:01 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:36:02.156972 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-02295061-59b5-4c06-9afb-d813fb0b8026 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] HTTP exception thrown: Instance e8af1592-80ef-4b09-b8d6-05880da48fae could not be found. Feb 08 17:36:02.157600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-02295061-59b5-4c06-9afb-d813fb0b8026 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Returning 404 to user: Instance e8af1592-80ef-4b09-b8d6-05880da48fae could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:36:02.158515 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-02295061-59b5-4c06-9afb-d813fb0b8026 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 404 len: 111 microversion: 2.1 time: 0.043851 Feb 08 17:36:02.159148 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 457/939] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:36:02 2022] DELETE /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:36:02.171766 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1e39838e-2d8c-4eb9-8aeb-2d479c660804 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:02.172864 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1e39838e-2d8c-4eb9-8aeb-2d479c660804 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: e8af1592-80ef-4b09-b8d6-05880da48fae] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:02.186910 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1e39838e-2d8c-4eb9-8aeb-2d479c660804 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:02.187746 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1e39838e-2d8c-4eb9-8aeb-2d479c660804 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:02.188778 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1e39838e-2d8c-4eb9-8aeb-2d479c660804 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:02.189514 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1e39838e-2d8c-4eb9-8aeb-2d479c660804 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:02.212376 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-1e39838e-2d8c-4eb9-8aeb-2d479c660804 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] HTTP exception thrown: Instance e8af1592-80ef-4b09-b8d6-05880da48fae could not be found. Feb 08 17:36:02.213803 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1e39838e-2d8c-4eb9-8aeb-2d479c660804 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Returning 404 to user: Instance e8af1592-80ef-4b09-b8d6-05880da48fae could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:36:02.215088 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1e39838e-2d8c-4eb9-8aeb-2d479c660804 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae" status: 404 len: 111 microversion: 2.1 time: 0.050916 Feb 08 17:36:02.216290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 483/940] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:36:02 2022] GET /compute/v2.1/servers/e8af1592-80ef-4b09-b8d6-05880da48fae => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:36:03.123535 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4b253828-d7be-4a19-a353-19bfdde5e95e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:03.126458 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4b253828-d7be-4a19-a353-19bfdde5e95e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:03.137625 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4b253828-d7be-4a19-a353-19bfdde5e95e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:03.138280 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4b253828-d7be-4a19-a353-19bfdde5e95e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:03.139257 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4b253828-d7be-4a19-a353-19bfdde5e95e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:03.139850 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4b253828-d7be-4a19-a353-19bfdde5e95e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:03.159988 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-062442c7-6a51-4609-987c-7d41f5a0bbb3 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:03.161080 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-062442c7-6a51-4609-987c-7d41f5a0bbb3 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:03.174812 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-062442c7-6a51-4609-987c-7d41f5a0bbb3 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:03.176026 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-062442c7-6a51-4609-987c-7d41f5a0bbb3 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:03.177595 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-062442c7-6a51-4609-987c-7d41f5a0bbb3 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:03.179739 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-062442c7-6a51-4609-987c-7d41f5a0bbb3 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:03.536179 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4b253828-d7be-4a19-a353-19bfdde5e95e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:03.554695 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4b253828-d7be-4a19-a353-19bfdde5e95e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:03.560959 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-062442c7-6a51-4609-987c-7d41f5a0bbb3 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:03.569370 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4b253828-d7be-4a19-a353-19bfdde5e95e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:03.582323 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-062442c7-6a51-4609-987c-7d41f5a0bbb3 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.428812 Feb 08 17:36:03.585147 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4b253828-d7be-4a19-a353-19bfdde5e95e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.464979 Feb 08 17:36:03.586294 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 458/941] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:03 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:03.595622 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 484/942] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:36:03 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:36:03.597123 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-08ba6999-eed1-4241-8f89-392cc6a77059 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:03.598502 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-08ba6999-eed1-4241-8f89-392cc6a77059 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:03.609856 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-08ba6999-eed1-4241-8f89-392cc6a77059 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:03.611101 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-08ba6999-eed1-4241-8f89-392cc6a77059 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:03.613023 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-08ba6999-eed1-4241-8f89-392cc6a77059 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:03.614100 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-08ba6999-eed1-4241-8f89-392cc6a77059 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:03.649387 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-08ba6999-eed1-4241-8f89-392cc6a77059 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] HTTP exception thrown: Instance 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 could not be found. Feb 08 17:36:03.651304 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-08ba6999-eed1-4241-8f89-392cc6a77059 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Returning 404 to user: Instance 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:36:03.653381 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-b493b59d-9ed8-4acc-b954-617388646f3e req-6bd76f0e-9c2d-4f47-ae07-845c884ae1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8692ef30-50d2-43bc-84ad-1d7308a694cf", "name": "network-vif-plugged", "status": "completed", "tag": "cf060131-592b-49f3-bed4-02a89d544e1f"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:36:03.653795 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-08ba6999-eed1-4241-8f89-392cc6a77059 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 404 len: 111 microversion: 2.1 time: 0.064952 Feb 08 17:36:03.655703 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 459/943] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:36:03 2022] DELETE /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:36:03.657464 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:36:03.657464 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:36:03.672255 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-b493b59d-9ed8-4acc-b954-617388646f3e req-6bd76f0e-9c2d-4f47-ae07-845c884ae1bf service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:03.673994 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-b493b59d-9ed8-4acc-b954-617388646f3e req-6bd76f0e-9c2d-4f47-ae07-845c884ae1bf service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:03.688700 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-09323549-048b-4ee9-9b85-05ff8ece0fd2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:03.690101 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-09323549-048b-4ee9-9b85-05ff8ece0fd2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] [instance: 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:03.701089 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-b493b59d-9ed8-4acc-b954-617388646f3e req-6bd76f0e-9c2d-4f47-ae07-845c884ae1bf service nova] Creating event network-vif-plugged:cf060131-592b-49f3-bed4-02a89d544e1f for instance 8692ef30-50d2-43bc-84ad-1d7308a694cf on hv-cinder-82204 Feb 08 17:36:03.715286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09323549-048b-4ee9-9b85-05ff8ece0fd2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:03.716445 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09323549-048b-4ee9-9b85-05ff8ece0fd2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:03.718233 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09323549-048b-4ee9-9b85-05ff8ece0fd2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:03.720535 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-09323549-048b-4ee9-9b85-05ff8ece0fd2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:03.727849 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-b493b59d-9ed8-4acc-b954-617388646f3e req-6bd76f0e-9c2d-4f47-ae07-845c884ae1bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079213 Feb 08 17:36:03.732050 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 485/944] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:36:03.759798 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-09323549-048b-4ee9-9b85-05ff8ece0fd2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] HTTP exception thrown: Instance 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 could not be found. Feb 08 17:36:03.761375 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-09323549-048b-4ee9-9b85-05ff8ece0fd2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] Returning 404 to user: Instance 8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:36:03.763619 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-09323549-048b-4ee9-9b85-05ff8ece0fd2 tempest-AttachVolumeTestJSON-923716161 tempest-AttachVolumeTestJSON-923716161-project] 10.222.0.69 "GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0" status: 404 len: 111 microversion: 2.1 time: 0.098945 Feb 08 17:36:03.765571 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 460/945] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:36:03 2022] GET /compute/v2.1/servers/8921a8f3-fa2c-43e4-90fa-a8a936c1eda0 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:36:04.616829 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f7f09b59-9553-4bb7-8350-578f7e49ba3e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:04.617755 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f7f09b59-9553-4bb7-8350-578f7e49ba3e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:04.618286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-366249d8-9274-49ed-8209-a4fb2d2666de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:04.619241 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-366249d8-9274-49ed-8209-a4fb2d2666de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:04.633578 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-366249d8-9274-49ed-8209-a4fb2d2666de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:04.634566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7f09b59-9553-4bb7-8350-578f7e49ba3e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:04.636336 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-366249d8-9274-49ed-8209-a4fb2d2666de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:04.637664 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7f09b59-9553-4bb7-8350-578f7e49ba3e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:04.638924 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7f09b59-9553-4bb7-8350-578f7e49ba3e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:04.646345 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f7f09b59-9553-4bb7-8350-578f7e49ba3e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:04.657428 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-366249d8-9274-49ed-8209-a4fb2d2666de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:04.658396 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-366249d8-9274-49ed-8209-a4fb2d2666de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:05.006779 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f7f09b59-9553-4bb7-8350-578f7e49ba3e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:05.019358 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-366249d8-9274-49ed-8209-a4fb2d2666de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:05.023508 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f7f09b59-9553-4bb7-8350-578f7e49ba3e tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.412259 Feb 08 17:36:05.038722 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 486/946] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:36:04 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:36:05.043949 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-366249d8-9274-49ed-8209-a4fb2d2666de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:05.047796 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-366249d8-9274-49ed-8209-a4fb2d2666de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:05.050900 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-366249d8-9274-49ed-8209-a4fb2d2666de tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.439447 Feb 08 17:36:05.052223 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 461/947] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:04 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:06.054686 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-eada01e6-6f52-47c8-82b2-1eb64f778632 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:06.056469 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-eada01e6-6f52-47c8-82b2-1eb64f778632 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:06.069501 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eada01e6-6f52-47c8-82b2-1eb64f778632 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:06.070410 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eada01e6-6f52-47c8-82b2-1eb64f778632 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:06.074326 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eada01e6-6f52-47c8-82b2-1eb64f778632 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:06.074326 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-eada01e6-6f52-47c8-82b2-1eb64f778632 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:06.082868 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-75bbd69a-df5d-40d4-986b-7e75048cb093 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:06.084100 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-75bbd69a-df5d-40d4-986b-7e75048cb093 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:06.109588 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75bbd69a-df5d-40d4-986b-7e75048cb093 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:06.110079 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75bbd69a-df5d-40d4-986b-7e75048cb093 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:06.111398 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75bbd69a-df5d-40d4-986b-7e75048cb093 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:06.112434 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75bbd69a-df5d-40d4-986b-7e75048cb093 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:06.517080 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-eada01e6-6f52-47c8-82b2-1eb64f778632 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:06.528790 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-eada01e6-6f52-47c8-82b2-1eb64f778632 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1260 microversion: 2.1 time: 0.483095 Feb 08 17:36:06.545700 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 487/948] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:36:06 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1260 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:36:06.702785 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-75bbd69a-df5d-40d4-986b-7e75048cb093 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:06.719391 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-75bbd69a-df5d-40d4-986b-7e75048cb093 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:06.725606 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-75bbd69a-df5d-40d4-986b-7e75048cb093 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:06.727096 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-75bbd69a-df5d-40d4-986b-7e75048cb093 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.649985 Feb 08 17:36:06.742433 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 462/949] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:06 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:07.560283 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-66473d13-eb47-4611-86dc-e4f926f0677c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:07.566872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-66473d13-eb47-4611-86dc-e4f926f0677c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:07.579686 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-66473d13-eb47-4611-86dc-e4f926f0677c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:07.581337 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-66473d13-eb47-4611-86dc-e4f926f0677c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:07.583353 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-66473d13-eb47-4611-86dc-e4f926f0677c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:07.584692 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-66473d13-eb47-4611-86dc-e4f926f0677c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:07.759027 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-91267913-cd72-4748-8679-3e71efb31341 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:07.760645 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-91267913-cd72-4748-8679-3e71efb31341 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:07.768436 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-91267913-cd72-4748-8679-3e71efb31341 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:07.769492 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-91267913-cd72-4748-8679-3e71efb31341 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:07.770605 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-91267913-cd72-4748-8679-3e71efb31341 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:07.771418 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-91267913-cd72-4748-8679-3e71efb31341 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:07.869385 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-66473d13-eb47-4611-86dc-e4f926f0677c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:07.882389 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-66473d13-eb47-4611-86dc-e4f926f0677c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1443 microversion: 2.1 time: 0.328817 Feb 08 17:36:07.883370 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 488/950] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:36:07 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1443 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:36:07.910985 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-43052e51-1bc9-42e4-aa57-27d436c5fd38 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:07.913530 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-43052e51-1bc9-42e4-aa57-27d436c5fd38 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:07.921714 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43052e51-1bc9-42e4-aa57-27d436c5fd38 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:07.923036 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43052e51-1bc9-42e4-aa57-27d436c5fd38 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:07.924035 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43052e51-1bc9-42e4-aa57-27d436c5fd38 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:07.925137 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43052e51-1bc9-42e4-aa57-27d436c5fd38 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:08.170267 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-91267913-cd72-4748-8679-3e71efb31341 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:08.182850 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-91267913-cd72-4748-8679-3e71efb31341 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:08.213857 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-91267913-cd72-4748-8679-3e71efb31341 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:08.217396 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-91267913-cd72-4748-8679-3e71efb31341 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.463613 Feb 08 17:36:08.222621 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 463/951] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:07 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:08.377290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-43052e51-1bc9-42e4-aa57-27d436c5fd38 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:08.404966 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-43052e51-1bc9-42e4-aa57-27d436c5fd38 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1443 microversion: 2.1 time: 0.500506 Feb 08 17:36:08.406935 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 489/952] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:36:07 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1443 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:36:09.264781 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0ad2dd6e-a887-4794-8ccf-e213803178e5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:09.280960 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0ad2dd6e-a887-4794-8ccf-e213803178e5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:09.316516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0ad2dd6e-a887-4794-8ccf-e213803178e5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:09.317569 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0ad2dd6e-a887-4794-8ccf-e213803178e5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:09.328888 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0ad2dd6e-a887-4794-8ccf-e213803178e5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:09.331536 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0ad2dd6e-a887-4794-8ccf-e213803178e5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:10.113275 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0ad2dd6e-a887-4794-8ccf-e213803178e5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:10.146173 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0ad2dd6e-a887-4794-8ccf-e213803178e5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:10.156765 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0ad2dd6e-a887-4794-8ccf-e213803178e5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:10.158904 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0ad2dd6e-a887-4794-8ccf-e213803178e5 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.905900 Feb 08 17:36:10.160202 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 464/953] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:09 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:11.193229 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7d2c3d2f-9e3d-418d-9352-aa7c41e76ea1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:11.197468 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7d2c3d2f-9e3d-418d-9352-aa7c41e76ea1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:11.213854 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d2c3d2f-9e3d-418d-9352-aa7c41e76ea1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:11.215125 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d2c3d2f-9e3d-418d-9352-aa7c41e76ea1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:11.217710 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d2c3d2f-9e3d-418d-9352-aa7c41e76ea1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:11.218797 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7d2c3d2f-9e3d-418d-9352-aa7c41e76ea1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:11.873454 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7d2c3d2f-9e3d-418d-9352-aa7c41e76ea1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:11.892730 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7d2c3d2f-9e3d-418d-9352-aa7c41e76ea1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:11.897529 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7d2c3d2f-9e3d-418d-9352-aa7c41e76ea1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:11.899827 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7d2c3d2f-9e3d-418d-9352-aa7c41e76ea1 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.715183 Feb 08 17:36:11.929742 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 490/954] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:11 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:12.940985 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5b74c80d-3af1-4150-8aa4-a7d104c04bcf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:12.944036 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5b74c80d-3af1-4150-8aa4-a7d104c04bcf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:12.957949 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5b74c80d-3af1-4150-8aa4-a7d104c04bcf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:12.959271 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5b74c80d-3af1-4150-8aa4-a7d104c04bcf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:12.962323 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5b74c80d-3af1-4150-8aa4-a7d104c04bcf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:12.963530 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5b74c80d-3af1-4150-8aa4-a7d104c04bcf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:13.823203 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-c4ae63fd-e317-4425-a8c6-fd53c93bc9f8 req-41bf3a78-e170-4d29-a6f6-243b5206397c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8692ef30-50d2-43bc-84ad-1d7308a694cf", "tag": "cf060131-592b-49f3-bed4-02a89d544e1f"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:36:13.837131 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5b74c80d-3af1-4150-8aa4-a7d104c04bcf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:13.841283 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:36:13.841283 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:36:13.857831 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-c4ae63fd-e317-4425-a8c6-fd53c93bc9f8 req-41bf3a78-e170-4d29-a6f6-243b5206397c service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:13.860518 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-c4ae63fd-e317-4425-a8c6-fd53c93bc9f8 req-41bf3a78-e170-4d29-a6f6-243b5206397c service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:13.883986 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-c4ae63fd-e317-4425-a8c6-fd53c93bc9f8 req-41bf3a78-e170-4d29-a6f6-243b5206397c service nova] Creating event network-changed:cf060131-592b-49f3-bed4-02a89d544e1f for instance 8692ef30-50d2-43bc-84ad-1d7308a694cf on hv-cinder-82204 Feb 08 17:36:13.886919 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5b74c80d-3af1-4150-8aa4-a7d104c04bcf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:13.889821 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-5b74c80d-3af1-4150-8aa4-a7d104c04bcf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:13.892188 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5b74c80d-3af1-4150-8aa4-a7d104c04bcf tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1737 microversion: 2.20 time: 0.962063 Feb 08 17:36:13.893442 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 465/955] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:12 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1737 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:36:13.896685 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-c4ae63fd-e317-4425-a8c6-fd53c93bc9f8 req-41bf3a78-e170-4d29-a6f6-243b5206397c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084796 Feb 08 17:36:13.898521 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 491/956] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:36:14.929626 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-029676ce-bb80-46ac-9167-09d103b57e35 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:14.934686 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-029676ce-bb80-46ac-9167-09d103b57e35 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:14.955561 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-029676ce-bb80-46ac-9167-09d103b57e35 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:14.956331 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-029676ce-bb80-46ac-9167-09d103b57e35 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:14.972306 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-029676ce-bb80-46ac-9167-09d103b57e35 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:14.973499 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-029676ce-bb80-46ac-9167-09d103b57e35 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:15.838633 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-029676ce-bb80-46ac-9167-09d103b57e35 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:15.857407 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-029676ce-bb80-46ac-9167-09d103b57e35 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:15.861319 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-029676ce-bb80-46ac-9167-09d103b57e35 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:15.866234 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-029676ce-bb80-46ac-9167-09d103b57e35 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1719 microversion: 2.20 time: 0.941707 Feb 08 17:36:15.867383 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 466/957] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:14 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1719 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:36:16.902624 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8bbc0309-7c96-4be1-bc53-33cd0bd82916 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:16.903787 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8bbc0309-7c96-4be1-bc53-33cd0bd82916 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:16.915936 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8bbc0309-7c96-4be1-bc53-33cd0bd82916 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:16.916892 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8bbc0309-7c96-4be1-bc53-33cd0bd82916 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:16.918556 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8bbc0309-7c96-4be1-bc53-33cd0bd82916 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:16.919543 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8bbc0309-7c96-4be1-bc53-33cd0bd82916 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:17.207477 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8bbc0309-7c96-4be1-bc53-33cd0bd82916 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:17.223251 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8bbc0309-7c96-4be1-bc53-33cd0bd82916 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:17.227073 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8bbc0309-7c96-4be1-bc53-33cd0bd82916 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:17.231275 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8bbc0309-7c96-4be1-bc53-33cd0bd82916 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1719 microversion: 2.20 time: 0.338954 Feb 08 17:36:17.231275 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 492/958] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:16 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1719 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:17.446106 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-ed745998-9387-4fd4-a695-2d20f30ac152 req-823343af-80d4-4b72-9832-5d25570edaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9897ad7c-5c82-4c2d-ad35-d99660e7a347", "name": "network-vif-unplugged", "status": "completed", "tag": "a4c518af-c3fe-4c2a-bf7f-55f78233f5e9"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:36:17.449689 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:36:17.449689 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:36:17.462582 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-ed745998-9387-4fd4-a695-2d20f30ac152 req-823343af-80d4-4b72-9832-5d25570edaeb service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:17.462582 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-ed745998-9387-4fd4-a695-2d20f30ac152 req-823343af-80d4-4b72-9832-5d25570edaeb service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:17.483112 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-ed745998-9387-4fd4-a695-2d20f30ac152 req-823343af-80d4-4b72-9832-5d25570edaeb service nova] Creating event network-vif-unplugged:a4c518af-c3fe-4c2a-bf7f-55f78233f5e9 for instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 on hv-cinder-82204 Feb 08 17:36:17.493614 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-ed745998-9387-4fd4-a695-2d20f30ac152 req-823343af-80d4-4b72-9832-5d25570edaeb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053220 Feb 08 17:36:17.494852 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 467/959] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:36:18.263123 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ec638f89-76d3-4fc5-8b94-e413d6365157 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:18.265452 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ec638f89-76d3-4fc5-8b94-e413d6365157 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:18.275776 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ec638f89-76d3-4fc5-8b94-e413d6365157 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:18.275776 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ec638f89-76d3-4fc5-8b94-e413d6365157 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:18.276637 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ec638f89-76d3-4fc5-8b94-e413d6365157 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:18.277407 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ec638f89-76d3-4fc5-8b94-e413d6365157 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:18.569273 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ec638f89-76d3-4fc5-8b94-e413d6365157 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:18.585771 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ec638f89-76d3-4fc5-8b94-e413d6365157 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:18.587678 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-ec638f89-76d3-4fc5-8b94-e413d6365157 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:18.589149 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ec638f89-76d3-4fc5-8b94-e413d6365157 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1719 microversion: 2.20 time: 0.331539 Feb 08 17:36:18.589913 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 493/960] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:18 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1719 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:36:19.613533 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-613eeedb-11ad-48e4-94a5-fc37edae9a10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:19.615151 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-613eeedb-11ad-48e4-94a5-fc37edae9a10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:19.624129 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-613eeedb-11ad-48e4-94a5-fc37edae9a10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:19.625061 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-613eeedb-11ad-48e4-94a5-fc37edae9a10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:19.626130 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-613eeedb-11ad-48e4-94a5-fc37edae9a10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:19.627324 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-613eeedb-11ad-48e4-94a5-fc37edae9a10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:19.930901 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-613eeedb-11ad-48e4-94a5-fc37edae9a10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:19.944666 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-613eeedb-11ad-48e4-94a5-fc37edae9a10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:19.946819 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-613eeedb-11ad-48e4-94a5-fc37edae9a10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:19.948968 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-613eeedb-11ad-48e4-94a5-fc37edae9a10 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1719 microversion: 2.20 time: 0.340131 Feb 08 17:36:19.949830 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 468/961] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:19 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1719 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:20.979252 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a4608e08-9915-4bc7-b85b-ac8b32117abe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:20.980900 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a4608e08-9915-4bc7-b85b-ac8b32117abe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:20.992579 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4608e08-9915-4bc7-b85b-ac8b32117abe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:20.993504 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4608e08-9915-4bc7-b85b-ac8b32117abe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:20.994882 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4608e08-9915-4bc7-b85b-ac8b32117abe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:20.995963 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a4608e08-9915-4bc7-b85b-ac8b32117abe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:21.242783 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a4608e08-9915-4bc7-b85b-ac8b32117abe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:21.252973 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a4608e08-9915-4bc7-b85b-ac8b32117abe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:21.254582 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a4608e08-9915-4bc7-b85b-ac8b32117abe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:21.257307 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a4608e08-9915-4bc7-b85b-ac8b32117abe tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1662 microversion: 2.20 time: 0.285493 Feb 08 17:36:21.258338 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 494/962] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:20 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1662 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:21.291781 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4098972d-648c-4c62-b4da-9b76448c1d49 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75c319a2-d944-426c-a119-39cc0bd5b864"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:36:21.293005 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4098972d-648c-4c62-b4da-9b76448c1d49 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:21.303463 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4098972d-648c-4c62-b4da-9b76448c1d49 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:21.304396 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4098972d-648c-4c62-b4da-9b76448c1d49 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:21.305744 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4098972d-648c-4c62-b4da-9b76448c1d49 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:21.306132 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4098972d-648c-4c62-b4da-9b76448c1d49 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:21.768990 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4098972d-648c-4c62-b4da-9b76448c1d49 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "POST /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.484632 Feb 08 17:36:21.769884 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 469/963] 10.222.0.69 () {62 vars in 1363 bytes} [Tue Feb 8 17:36:21 2022] POST /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/os-volume_attachments => generated 188 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 17:36:21.931947 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-89596d14-3199-4bb7-8319-61fd7871320d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:21.932367 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-89596d14-3199-4bb7-8319-61fd7871320d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:21.943278 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89596d14-3199-4bb7-8319-61fd7871320d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:21.943748 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89596d14-3199-4bb7-8319-61fd7871320d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:21.944609 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89596d14-3199-4bb7-8319-61fd7871320d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:21.945059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-89596d14-3199-4bb7-8319-61fd7871320d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:22.279611 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-89596d14-3199-4bb7-8319-61fd7871320d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/os-volume_attachments/75c319a2-d944-426c-a119-39cc0bd5b864" status: 202 len: 0 microversion: 2.20 time: 0.351612 Feb 08 17:36:22.280702 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 495/964] 10.222.0.69 () {60 vars in 1456 bytes} [Tue Feb 8 17:36:21 2022] DELETE /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/os-volume_attachments/75c319a2-d944-426c-a119-39cc0bd5b864 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 08 17:36:22.392312 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-252d6e98-d35c-4adf-bec6-035e435b7d88 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:36:22.394835 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-252d6e98-d35c-4adf-bec6-035e435b7d88 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:22.406969 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-252d6e98-d35c-4adf-bec6-035e435b7d88 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:22.407615 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-252d6e98-d35c-4adf-bec6-035e435b7d88 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:22.408969 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-252d6e98-d35c-4adf-bec6-035e435b7d88 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:22.409592 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-252d6e98-d35c-4adf-bec6-035e435b7d88 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:22.556785 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-252d6e98-d35c-4adf-bec6-035e435b7d88 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "POST /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/action" status: 202 len: 0 microversion: 2.20 time: 0.171995 Feb 08 17:36:22.561526 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 470/965] 10.222.0.69 () {62 vars in 1318 bytes} [Tue Feb 8 17:36:22 2022] POST /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 08 17:36:22.572042 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3b8eba4b-08bc-4d7f-bda4-6f50741ee62f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:22.573110 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3b8eba4b-08bc-4d7f-bda4-6f50741ee62f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:22.584623 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b8eba4b-08bc-4d7f-bda4-6f50741ee62f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:22.585445 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b8eba4b-08bc-4d7f-bda4-6f50741ee62f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:22.587268 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b8eba4b-08bc-4d7f-bda4-6f50741ee62f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:22.587953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3b8eba4b-08bc-4d7f-bda4-6f50741ee62f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:22.867385 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3b8eba4b-08bc-4d7f-bda4-6f50741ee62f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:22.887199 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3b8eba4b-08bc-4d7f-bda4-6f50741ee62f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:22.889949 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3b8eba4b-08bc-4d7f-bda4-6f50741ee62f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:22.891847 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3b8eba4b-08bc-4d7f-bda4-6f50741ee62f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1670 microversion: 2.20 time: 0.327632 Feb 08 17:36:22.892801 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 496/966] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:22 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1670 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:23.922402 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6b2f5725-934d-46c8-9399-b879d08e6ee2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:23.923602 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6b2f5725-934d-46c8-9399-b879d08e6ee2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:23.931075 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6b2f5725-934d-46c8-9399-b879d08e6ee2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:23.931737 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6b2f5725-934d-46c8-9399-b879d08e6ee2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:23.932540 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6b2f5725-934d-46c8-9399-b879d08e6ee2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:23.933180 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6b2f5725-934d-46c8-9399-b879d08e6ee2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:24.211910 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6b2f5725-934d-46c8-9399-b879d08e6ee2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:24.223418 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6b2f5725-934d-46c8-9399-b879d08e6ee2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:24.226469 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6b2f5725-934d-46c8-9399-b879d08e6ee2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:24.227929 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6b2f5725-934d-46c8-9399-b879d08e6ee2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.310249 Feb 08 17:36:24.228671 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 471/967] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:23 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:25.254501 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-dcf31a13-6653-4e40-a0b4-fb4a0d59b99f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:25.256063 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-dcf31a13-6653-4e40-a0b4-fb4a0d59b99f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:25.266313 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dcf31a13-6653-4e40-a0b4-fb4a0d59b99f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:25.267430 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dcf31a13-6653-4e40-a0b4-fb4a0d59b99f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:25.269021 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dcf31a13-6653-4e40-a0b4-fb4a0d59b99f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:25.270071 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-dcf31a13-6653-4e40-a0b4-fb4a0d59b99f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:25.510909 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-dcf31a13-6653-4e40-a0b4-fb4a0d59b99f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:25.527935 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-dcf31a13-6653-4e40-a0b4-fb4a0d59b99f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:25.531135 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-dcf31a13-6653-4e40-a0b4-fb4a0d59b99f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:25.533399 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-dcf31a13-6653-4e40-a0b4-fb4a0d59b99f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.285124 Feb 08 17:36:25.535098 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 497/968] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:25 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:26.553047 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b56a58d6-ba63-4349-84b1-490e4af7720d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:26.553802 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b56a58d6-ba63-4349-84b1-490e4af7720d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:26.562963 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b56a58d6-ba63-4349-84b1-490e4af7720d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:26.564234 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b56a58d6-ba63-4349-84b1-490e4af7720d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:26.566065 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b56a58d6-ba63-4349-84b1-490e4af7720d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:26.566865 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b56a58d6-ba63-4349-84b1-490e4af7720d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:26.896620 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b56a58d6-ba63-4349-84b1-490e4af7720d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:26.933317 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b56a58d6-ba63-4349-84b1-490e4af7720d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:26.941986 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-b56a58d6-ba63-4349-84b1-490e4af7720d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:26.944883 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b56a58d6-ba63-4349-84b1-490e4af7720d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.396278 Feb 08 17:36:26.950115 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 472/969] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:26 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:27.968791 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-43a65e98-1c74-4106-90e5-4874f45ef1fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:27.969681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-43a65e98-1c74-4106-90e5-4874f45ef1fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:27.986612 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43a65e98-1c74-4106-90e5-4874f45ef1fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:27.987424 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43a65e98-1c74-4106-90e5-4874f45ef1fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:27.988333 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43a65e98-1c74-4106-90e5-4874f45ef1fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:27.988849 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43a65e98-1c74-4106-90e5-4874f45ef1fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:28.269151 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-43a65e98-1c74-4106-90e5-4874f45ef1fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:28.294919 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-43a65e98-1c74-4106-90e5-4874f45ef1fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:28.299511 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-43a65e98-1c74-4106-90e5-4874f45ef1fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:28.303207 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-43a65e98-1c74-4106-90e5-4874f45ef1fc tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.337659 Feb 08 17:36:28.305283 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 498/970] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:27 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:36:29.338370 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cee99f40-f426-4dcd-a362-fd7a9666efb0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:29.339396 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-cee99f40-f426-4dcd-a362-fd7a9666efb0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:29.357983 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cee99f40-f426-4dcd-a362-fd7a9666efb0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:29.370600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cee99f40-f426-4dcd-a362-fd7a9666efb0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:29.372561 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cee99f40-f426-4dcd-a362-fd7a9666efb0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:29.373830 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-cee99f40-f426-4dcd-a362-fd7a9666efb0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:29.764153 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cee99f40-f426-4dcd-a362-fd7a9666efb0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:29.782010 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cee99f40-f426-4dcd-a362-fd7a9666efb0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:29.785710 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-cee99f40-f426-4dcd-a362-fd7a9666efb0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:29.788787 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cee99f40-f426-4dcd-a362-fd7a9666efb0 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.455491 Feb 08 17:36:29.790589 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 473/971] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:29 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:30.241509 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:36:30.242428 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: Tue Feb 8 17:36:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:36:30.820301 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a2e2960c-013a-4efd-aac3-0326ab5e9273 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:30.821659 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a2e2960c-013a-4efd-aac3-0326ab5e9273 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:30.829511 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a2e2960c-013a-4efd-aac3-0326ab5e9273 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:30.829977 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a2e2960c-013a-4efd-aac3-0326ab5e9273 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:30.830822 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a2e2960c-013a-4efd-aac3-0326ab5e9273 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:30.831269 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a2e2960c-013a-4efd-aac3-0326ab5e9273 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:31.076561 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a2e2960c-013a-4efd-aac3-0326ab5e9273 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:31.086868 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a2e2960c-013a-4efd-aac3-0326ab5e9273 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:31.088685 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a2e2960c-013a-4efd-aac3-0326ab5e9273 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:31.090623 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a2e2960c-013a-4efd-aac3-0326ab5e9273 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.274861 Feb 08 17:36:31.091938 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 499/972] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:30 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:32.116223 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ddd16a60-d1dd-4cbd-a62e-b9076103178e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:32.117784 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ddd16a60-d1dd-4cbd-a62e-b9076103178e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:32.124868 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ddd16a60-d1dd-4cbd-a62e-b9076103178e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:32.125942 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ddd16a60-d1dd-4cbd-a62e-b9076103178e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:32.127354 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ddd16a60-d1dd-4cbd-a62e-b9076103178e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:32.128135 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ddd16a60-d1dd-4cbd-a62e-b9076103178e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:32.389660 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ddd16a60-d1dd-4cbd-a62e-b9076103178e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:32.406238 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ddd16a60-d1dd-4cbd-a62e-b9076103178e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:32.410583 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ddd16a60-d1dd-4cbd-a62e-b9076103178e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:32.414394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ddd16a60-d1dd-4cbd-a62e-b9076103178e tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.306636 Feb 08 17:36:32.431642 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 474/973] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:32 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:36:33.449677 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1dd4b994-33f4-41c5-b211-c923817f8901 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:33.450888 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1dd4b994-33f4-41c5-b211-c923817f8901 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:33.459017 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1dd4b994-33f4-41c5-b211-c923817f8901 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:33.459681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1dd4b994-33f4-41c5-b211-c923817f8901 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:33.460919 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1dd4b994-33f4-41c5-b211-c923817f8901 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:33.461781 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1dd4b994-33f4-41c5-b211-c923817f8901 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:33.693859 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1dd4b994-33f4-41c5-b211-c923817f8901 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:33.725481 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1dd4b994-33f4-41c5-b211-c923817f8901 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:33.727394 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1dd4b994-33f4-41c5-b211-c923817f8901 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:33.729728 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1dd4b994-33f4-41c5-b211-c923817f8901 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.284009 Feb 08 17:36:33.741466 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 500/974] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:33 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:34.754145 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a9ae7bdd-654d-4baf-a828-a45093d0a217 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:34.760585 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a9ae7bdd-654d-4baf-a828-a45093d0a217 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:34.783239 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a9ae7bdd-654d-4baf-a828-a45093d0a217 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:34.784492 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a9ae7bdd-654d-4baf-a828-a45093d0a217 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:34.786769 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a9ae7bdd-654d-4baf-a828-a45093d0a217 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:34.787923 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-a9ae7bdd-654d-4baf-a828-a45093d0a217 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:35.160687 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a9ae7bdd-654d-4baf-a828-a45093d0a217 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:35.209649 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a9ae7bdd-654d-4baf-a828-a45093d0a217 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:35.213551 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a9ae7bdd-654d-4baf-a828-a45093d0a217 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:35.225588 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a9ae7bdd-654d-4baf-a828-a45093d0a217 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.480222 Feb 08 17:36:35.235165 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 475/975] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:34 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:36.261398 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-6b12cc46-306e-49d4-a40c-a7cf1ded6a7f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:36.267161 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-6b12cc46-306e-49d4-a40c-a7cf1ded6a7f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:36.290777 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b12cc46-306e-49d4-a40c-a7cf1ded6a7f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:36.291413 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b12cc46-306e-49d4-a40c-a7cf1ded6a7f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:36.292940 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b12cc46-306e-49d4-a40c-a7cf1ded6a7f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:36.293850 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-6b12cc46-306e-49d4-a40c-a7cf1ded6a7f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:36.622821 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6b12cc46-306e-49d4-a40c-a7cf1ded6a7f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:36.651231 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6b12cc46-306e-49d4-a40c-a7cf1ded6a7f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:36.655064 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-6b12cc46-306e-49d4-a40c-a7cf1ded6a7f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:36.660429 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-6b12cc46-306e-49d4-a40c-a7cf1ded6a7f tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.408436 Feb 08 17:36:36.677918 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 501/976] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:36 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:37.695745 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d726f070-0b22-4315-86ae-76ecf0eba071 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:37.696733 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d726f070-0b22-4315-86ae-76ecf0eba071 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:37.704222 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d726f070-0b22-4315-86ae-76ecf0eba071 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:37.705177 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d726f070-0b22-4315-86ae-76ecf0eba071 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:37.706371 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d726f070-0b22-4315-86ae-76ecf0eba071 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:37.706973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d726f070-0b22-4315-86ae-76ecf0eba071 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:37.983506 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d726f070-0b22-4315-86ae-76ecf0eba071 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:37.995149 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d726f070-0b22-4315-86ae-76ecf0eba071 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:37.996841 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d726f070-0b22-4315-86ae-76ecf0eba071 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:37.998197 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d726f070-0b22-4315-86ae-76ecf0eba071 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.308675 Feb 08 17:36:38.009936 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 476/977] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:37 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:36:39.020739 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-98fe7509-7fd2-42f0-a9ea-675b26b04c73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:39.021660 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-98fe7509-7fd2-42f0-a9ea-675b26b04c73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:39.031640 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-98fe7509-7fd2-42f0-a9ea-675b26b04c73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:39.032458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-98fe7509-7fd2-42f0-a9ea-675b26b04c73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:39.033963 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-98fe7509-7fd2-42f0-a9ea-675b26b04c73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:39.034728 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-98fe7509-7fd2-42f0-a9ea-675b26b04c73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:39.260828 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-98fe7509-7fd2-42f0-a9ea-675b26b04c73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:39.279503 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-98fe7509-7fd2-42f0-a9ea-675b26b04c73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:39.281078 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-98fe7509-7fd2-42f0-a9ea-675b26b04c73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:39.282353 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-98fe7509-7fd2-42f0-a9ea-675b26b04c73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.268200 Feb 08 17:36:39.282910 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 502/978] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:39 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:40.319743 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-84a1b856-4a6f-4412-a126-857a3b5fbb00 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:40.320900 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-84a1b856-4a6f-4412-a126-857a3b5fbb00 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:40.333737 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-84a1b856-4a6f-4412-a126-857a3b5fbb00 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:40.334646 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-84a1b856-4a6f-4412-a126-857a3b5fbb00 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:40.336117 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-84a1b856-4a6f-4412-a126-857a3b5fbb00 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:40.337046 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-84a1b856-4a6f-4412-a126-857a3b5fbb00 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:40.598021 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-84a1b856-4a6f-4412-a126-857a3b5fbb00 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:40.613968 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-84a1b856-4a6f-4412-a126-857a3b5fbb00 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:40.617188 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-84a1b856-4a6f-4412-a126-857a3b5fbb00 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:40.619329 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-84a1b856-4a6f-4412-a126-857a3b5fbb00 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.309731 Feb 08 17:36:40.620209 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 477/979] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:40 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:41.648420 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c25c9ef1-4b95-4d2f-a0c1-47a8f9077803 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:41.649603 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c25c9ef1-4b95-4d2f-a0c1-47a8f9077803 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:41.657235 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c25c9ef1-4b95-4d2f-a0c1-47a8f9077803 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:41.657572 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c25c9ef1-4b95-4d2f-a0c1-47a8f9077803 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:41.658806 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c25c9ef1-4b95-4d2f-a0c1-47a8f9077803 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:41.659709 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c25c9ef1-4b95-4d2f-a0c1-47a8f9077803 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:41.882479 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c25c9ef1-4b95-4d2f-a0c1-47a8f9077803 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:41.909985 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c25c9ef1-4b95-4d2f-a0c1-47a8f9077803 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:41.912062 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c25c9ef1-4b95-4d2f-a0c1-47a8f9077803 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:41.914109 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c25c9ef1-4b95-4d2f-a0c1-47a8f9077803 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.272284 Feb 08 17:36:41.917499 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 503/980] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:41 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:36:42.938769 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-783df478-5ee1-4b94-a29c-97bec488cf44 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:42.939877 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-783df478-5ee1-4b94-a29c-97bec488cf44 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:42.951431 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-783df478-5ee1-4b94-a29c-97bec488cf44 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:42.952225 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-783df478-5ee1-4b94-a29c-97bec488cf44 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:42.953649 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-783df478-5ee1-4b94-a29c-97bec488cf44 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:42.954441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-783df478-5ee1-4b94-a29c-97bec488cf44 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:43.173867 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-783df478-5ee1-4b94-a29c-97bec488cf44 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:43.189475 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-783df478-5ee1-4b94-a29c-97bec488cf44 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:43.192911 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-783df478-5ee1-4b94-a29c-97bec488cf44 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:43.195349 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-783df478-5ee1-4b94-a29c-97bec488cf44 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.263110 Feb 08 17:36:43.196587 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 478/981] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:42 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 17:36:44.221888 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2d111ac2-fb34-4eed-8228-088a5d98b049 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:44.222568 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2d111ac2-fb34-4eed-8228-088a5d98b049 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:44.230451 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2d111ac2-fb34-4eed-8228-088a5d98b049 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:44.230942 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2d111ac2-fb34-4eed-8228-088a5d98b049 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:44.231746 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2d111ac2-fb34-4eed-8228-088a5d98b049 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:44.232272 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2d111ac2-fb34-4eed-8228-088a5d98b049 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:44.412117 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2d111ac2-fb34-4eed-8228-088a5d98b049 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:44.421360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2d111ac2-fb34-4eed-8228-088a5d98b049 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:44.423682 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2d111ac2-fb34-4eed-8228-088a5d98b049 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:44.424876 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2d111ac2-fb34-4eed-8228-088a5d98b049 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.207449 Feb 08 17:36:44.425468 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 504/982] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:44 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:45.463185 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-81875790-c0d4-4bb0-8ef9-2c85b0135465 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:45.465795 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-81875790-c0d4-4bb0-8ef9-2c85b0135465 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:45.476781 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-81875790-c0d4-4bb0-8ef9-2c85b0135465 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:45.477653 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-81875790-c0d4-4bb0-8ef9-2c85b0135465 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:45.479092 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-81875790-c0d4-4bb0-8ef9-2c85b0135465 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:45.479884 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-81875790-c0d4-4bb0-8ef9-2c85b0135465 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:45.760428 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-81875790-c0d4-4bb0-8ef9-2c85b0135465 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:45.772127 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-81875790-c0d4-4bb0-8ef9-2c85b0135465 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:45.774074 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-81875790-c0d4-4bb0-8ef9-2c85b0135465 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:45.775591 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-81875790-c0d4-4bb0-8ef9-2c85b0135465 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.321570 Feb 08 17:36:45.776303 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 479/983] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:45 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:46.799967 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e17dcfc0-39c4-4107-8a2e-d349e165a87d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:46.801134 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e17dcfc0-39c4-4107-8a2e-d349e165a87d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:46.812590 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e17dcfc0-39c4-4107-8a2e-d349e165a87d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:46.813538 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e17dcfc0-39c4-4107-8a2e-d349e165a87d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:46.814989 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e17dcfc0-39c4-4107-8a2e-d349e165a87d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:46.816332 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e17dcfc0-39c4-4107-8a2e-d349e165a87d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:47.023495 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e17dcfc0-39c4-4107-8a2e-d349e165a87d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:47.033724 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e17dcfc0-39c4-4107-8a2e-d349e165a87d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:47.035610 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e17dcfc0-39c4-4107-8a2e-d349e165a87d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:47.038844 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e17dcfc0-39c4-4107-8a2e-d349e165a87d tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.245315 Feb 08 17:36:47.040297 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 505/984] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:46 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:47.605053 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-5a221342-0a72-430c-963b-da0b68a07091 req-13785c07-c98a-4275-adea-cfb2d448b9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9897ad7c-5c82-4c2d-ad35-d99660e7a347", "name": "network-vif-plugged", "status": "completed", "tag": "a4c518af-c3fe-4c2a-bf7f-55f78233f5e9"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:36:47.608226 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:36:47.608226 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:36:47.622284 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-5a221342-0a72-430c-963b-da0b68a07091 req-13785c07-c98a-4275-adea-cfb2d448b9ed service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:47.622965 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-5a221342-0a72-430c-963b-da0b68a07091 req-13785c07-c98a-4275-adea-cfb2d448b9ed service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:47.650853 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-5a221342-0a72-430c-963b-da0b68a07091 req-13785c07-c98a-4275-adea-cfb2d448b9ed service nova] Creating event network-vif-plugged:a4c518af-c3fe-4c2a-bf7f-55f78233f5e9 for instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 on hv-cinder-82204 Feb 08 17:36:47.660373 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-5a221342-0a72-430c-963b-da0b68a07091 req-13785c07-c98a-4275-adea-cfb2d448b9ed service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059546 Feb 08 17:36:47.662044 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 480/985] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:36:48.064940 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b344ec22-4ffa-4d43-aa27-cad6733bd329 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:48.065968 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-b344ec22-4ffa-4d43-aa27-cad6733bd329 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:48.074747 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b344ec22-4ffa-4d43-aa27-cad6733bd329 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:48.075354 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b344ec22-4ffa-4d43-aa27-cad6733bd329 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:48.076316 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b344ec22-4ffa-4d43-aa27-cad6733bd329 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:48.076861 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b344ec22-4ffa-4d43-aa27-cad6733bd329 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:48.290899 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b344ec22-4ffa-4d43-aa27-cad6733bd329 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:48.303865 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b344ec22-4ffa-4d43-aa27-cad6733bd329 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:48.306637 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b344ec22-4ffa-4d43-aa27-cad6733bd329 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:48.308668 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b344ec22-4ffa-4d43-aa27-cad6733bd329 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.247642 Feb 08 17:36:48.309707 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 506/986] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:48 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:49.342100 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4d3a33d7-3d7e-4790-9712-00ec49b81a6c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:49.344518 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4d3a33d7-3d7e-4790-9712-00ec49b81a6c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:49.360258 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4d3a33d7-3d7e-4790-9712-00ec49b81a6c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:49.361655 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4d3a33d7-3d7e-4790-9712-00ec49b81a6c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:49.364491 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4d3a33d7-3d7e-4790-9712-00ec49b81a6c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:49.365428 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4d3a33d7-3d7e-4790-9712-00ec49b81a6c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:49.684370 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4d3a33d7-3d7e-4790-9712-00ec49b81a6c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:49.706279 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4d3a33d7-3d7e-4790-9712-00ec49b81a6c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:49.711012 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4d3a33d7-3d7e-4790-9712-00ec49b81a6c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:49.713545 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4d3a33d7-3d7e-4790-9712-00ec49b81a6c tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1728 microversion: 2.20 time: 0.378095 Feb 08 17:36:49.714313 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 481/987] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:49 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1728 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:36:50.757842 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3428d344-f076-455b-a19d-8ae3b17d2267 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:36:50.759121 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3428d344-f076-455b-a19d-8ae3b17d2267 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:36:50.769122 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3428d344-f076-455b-a19d-8ae3b17d2267 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:50.769609 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3428d344-f076-455b-a19d-8ae3b17d2267 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:50.770939 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3428d344-f076-455b-a19d-8ae3b17d2267 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:36:50.771372 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3428d344-f076-455b-a19d-8ae3b17d2267 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:36:50.948719 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3428d344-f076-455b-a19d-8ae3b17d2267 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:50.962657 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3428d344-f076-455b-a19d-8ae3b17d2267 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:50.965781 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3428d344-f076-455b-a19d-8ae3b17d2267 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:36:50.967957 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3428d344-f076-455b-a19d-8ae3b17d2267 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1715 microversion: 2.20 time: 0.217130 Feb 08 17:36:50.970696 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 507/988] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:36:50 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1715 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:37:42.964973 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4b3cddd0-0eb1-44eb-b783-bd4ee8e8fcea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:42.966030 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4b3cddd0-0eb1-44eb-b783-bd4ee8e8fcea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:37:42.973621 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4b3cddd0-0eb1-44eb-b783-bd4ee8e8fcea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:42.974098 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4b3cddd0-0eb1-44eb-b783-bd4ee8e8fcea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:42.974923 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4b3cddd0-0eb1-44eb-b783-bd4ee8e8fcea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:42.975365 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4b3cddd0-0eb1-44eb-b783-bd4ee8e8fcea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:43.007790 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4b3cddd0-0eb1-44eb-b783-bd4ee8e8fcea tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047379 Feb 08 17:37:43.008354 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 482/989] 10.222.0.69 () {60 vars in 1342 bytes} [Tue Feb 8 17:37:42 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:37:43.064680 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d23627ce-036e-46a6-9aea-ede7f3411c61 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:43.065281 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d23627ce-036e-46a6-9aea-ede7f3411c61 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:37:43.071331 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d23627ce-036e-46a6-9aea-ede7f3411c61 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:43.071775 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d23627ce-036e-46a6-9aea-ede7f3411c61 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:43.072549 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d23627ce-036e-46a6-9aea-ede7f3411c61 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:43.072993 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d23627ce-036e-46a6-9aea-ede7f3411c61 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:43.099244 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d23627ce-036e-46a6-9aea-ede7f3411c61 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:37:43.191466 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d23627ce-036e-46a6-9aea-ede7f3411c61 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 204 len: 0 microversion: 2.20 time: 0.130106 Feb 08 17:37:43.193882 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 508/990] 10.222.0.69 () {60 vars in 1279 bytes} [Tue Feb 8 17:37:43 2022] DELETE /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 08 17:37:43.205341 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-08e0238a-cf6c-445f-be73-1b8bacf0337b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:43.206377 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-08e0238a-cf6c-445f-be73-1b8bacf0337b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:37:43.214619 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-08e0238a-cf6c-445f-be73-1b8bacf0337b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:43.215315 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-08e0238a-cf6c-445f-be73-1b8bacf0337b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:43.216820 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-08e0238a-cf6c-445f-be73-1b8bacf0337b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:43.217448 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-08e0238a-cf6c-445f-be73-1b8bacf0337b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:43.391822 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-08e0238a-cf6c-445f-be73-1b8bacf0337b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:37:43.402746 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-08e0238a-cf6c-445f-be73-1b8bacf0337b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:37:43.404806 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-08e0238a-cf6c-445f-be73-1b8bacf0337b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:37:43.406021 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-08e0238a-cf6c-445f-be73-1b8bacf0337b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.205742 Feb 08 17:37:43.406595 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 483/991] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:37:43 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:37:44.431429 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a371deab-80b4-428a-bf9d-28b3abde4fbb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:44.432147 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a371deab-80b4-428a-bf9d-28b3abde4fbb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:37:44.442567 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a371deab-80b4-428a-bf9d-28b3abde4fbb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:44.443020 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a371deab-80b4-428a-bf9d-28b3abde4fbb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:44.443861 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a371deab-80b4-428a-bf9d-28b3abde4fbb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:44.444304 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a371deab-80b4-428a-bf9d-28b3abde4fbb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:44.610243 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a371deab-80b4-428a-bf9d-28b3abde4fbb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:37:44.675551 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a371deab-80b4-428a-bf9d-28b3abde4fbb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:37:44.677878 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-a371deab-80b4-428a-bf9d-28b3abde4fbb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:37:44.679462 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a371deab-80b4-428a-bf9d-28b3abde4fbb tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1721 microversion: 2.20 time: 0.255126 Feb 08 17:37:44.680188 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 509/992] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:37:44 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:37:45.701462 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-fcbf4309-00e7-496a-82ea-f5f3bc865e73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:45.702016 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-fcbf4309-00e7-496a-82ea-f5f3bc865e73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:37:45.715535 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fcbf4309-00e7-496a-82ea-f5f3bc865e73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:45.715996 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fcbf4309-00e7-496a-82ea-f5f3bc865e73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:45.716813 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fcbf4309-00e7-496a-82ea-f5f3bc865e73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:45.720005 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fcbf4309-00e7-496a-82ea-f5f3bc865e73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:45.916972 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-fcbf4309-00e7-496a-82ea-f5f3bc865e73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:37:45.930257 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-fcbf4309-00e7-496a-82ea-f5f3bc865e73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:37:45.931747 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-fcbf4309-00e7-496a-82ea-f5f3bc865e73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431b80f782ae4fd7962ca5e91fa7477f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db94ac5e06144fe93946c0c4df7e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:37:45.932935 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-fcbf4309-00e7-496a-82ea-f5f3bc865e73 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 200 len: 1654 microversion: 2.20 time: 0.237394 Feb 08 17:37:45.933494 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 484/993] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:37:45 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 1654 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 17:37:46.050799 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-90230e80-555e-48af-aa63-16a9ebf66ba1 req-894a7035-8e4b-4666-93d4-88fc3ff8cfb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9897ad7c-5c82-4c2d-ad35-d99660e7a347", "name": "network-vif-deleted", "tag": "a4c518af-c3fe-4c2a-bf7f-55f78233f5e9"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:37:46.052558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:37:46.052558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:37:46.071899 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-90230e80-555e-48af-aa63-16a9ebf66ba1 req-894a7035-8e4b-4666-93d4-88fc3ff8cfb4 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:46.072697 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-90230e80-555e-48af-aa63-16a9ebf66ba1 req-894a7035-8e4b-4666-93d4-88fc3ff8cfb4 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:46.116624 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-90230e80-555e-48af-aa63-16a9ebf66ba1 req-894a7035-8e4b-4666-93d4-88fc3ff8cfb4 service nova] Creating event network-vif-deleted:a4c518af-c3fe-4c2a-bf7f-55f78233f5e9 for instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 on hv-cinder-82204 Feb 08 17:37:46.127079 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-90230e80-555e-48af-aa63-16a9ebf66ba1 req-894a7035-8e4b-4666-93d4-88fc3ff8cfb4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085199 Feb 08 17:37:46.127832 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 510/994] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:37:46.951958 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e823ec13-5365-4f00-8b99-8a4c5a02e23b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:46.952660 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-e823ec13-5365-4f00-8b99-8a4c5a02e23b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:37:46.959138 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e823ec13-5365-4f00-8b99-8a4c5a02e23b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:46.959667 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e823ec13-5365-4f00-8b99-8a4c5a02e23b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:46.960461 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e823ec13-5365-4f00-8b99-8a4c5a02e23b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:46.960894 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e823ec13-5365-4f00-8b99-8a4c5a02e23b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:46.975141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-e823ec13-5365-4f00-8b99-8a4c5a02e23b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] HTTP exception thrown: Instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 could not be found. Feb 08 17:37:46.975734 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e823ec13-5365-4f00-8b99-8a4c5a02e23b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Returning 404 to user: Instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:37:46.976561 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e823ec13-5365-4f00-8b99-8a4c5a02e23b tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 404 len: 111 microversion: 2.20 time: 0.029036 Feb 08 17:37:46.977390 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 485/995] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:37:46 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 08 17:37:46.986262 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-575108c5-85d6-45f0-befe-3bb4c4be4d74 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '.version_select at 0x7fd9fa24f820>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:47.007001 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-575108c5-85d6-45f0-befe-3bb4c4be4d74 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117351584" status: 204 len: 0 microversion: 2.20 time: 0.024712 Feb 08 17:37:47.007737 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 511/996] 10.222.0.69 () {60 vars in 1261 bytes} [Tue Feb 8 17:37:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117351584 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 08 17:37:48.811827 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6145a98a-4a60-4071-b26b-3eccd44a4c07 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:48.812406 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6145a98a-4a60-4071-b26b-3eccd44a4c07 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:37:48.819711 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6145a98a-4a60-4071-b26b-3eccd44a4c07 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:48.820155 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6145a98a-4a60-4071-b26b-3eccd44a4c07 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:48.821021 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6145a98a-4a60-4071-b26b-3eccd44a4c07 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:48.821487 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6145a98a-4a60-4071-b26b-3eccd44a4c07 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:48.835424 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-6145a98a-4a60-4071-b26b-3eccd44a4c07 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] HTTP exception thrown: Instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 could not be found. Feb 08 17:37:48.836020 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6145a98a-4a60-4071-b26b-3eccd44a4c07 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Returning 404 to user: Instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:37:48.836853 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6145a98a-4a60-4071-b26b-3eccd44a4c07 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 404 len: 111 microversion: 2.20 time: 0.028811 Feb 08 17:37:48.837442 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 486/997] 10.222.0.69 () {60 vars in 1279 bytes} [Tue Feb 8 17:37:48 2022] DELETE /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 08 17:37:48.845766 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-42d150a1-993e-4515-9ac4-ce55da0152f2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:48.846535 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-42d150a1-993e-4515-9ac4-ce55da0152f2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: 9897ad7c-5c82-4c2d-ad35-d99660e7a347] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:37:48.854133 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-42d150a1-993e-4515-9ac4-ce55da0152f2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:48.854566 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-42d150a1-993e-4515-9ac4-ce55da0152f2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:48.855054 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-42d150a1-993e-4515-9ac4-ce55da0152f2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:48.855487 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-42d150a1-993e-4515-9ac4-ce55da0152f2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:48.872701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-42d150a1-993e-4515-9ac4-ce55da0152f2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] HTTP exception thrown: Instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 could not be found. Feb 08 17:37:48.873426 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-42d150a1-993e-4515-9ac4-ce55da0152f2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Returning 404 to user: Instance 9897ad7c-5c82-4c2d-ad35-d99660e7a347 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:37:48.874285 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-42d150a1-993e-4515-9ac4-ce55da0152f2 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347" status: 404 len: 111 microversion: 2.20 time: 0.032673 Feb 08 17:37:48.874857 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 512/998] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:37:48 2022] GET /compute/v2.1/servers/9897ad7c-5c82-4c2d-ad35-d99660e7a347 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 08 17:37:50.015836 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f9ca9ef1-2212-4a93-ab8b-3ec3dc61eb87 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:50.016372 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-f9ca9ef1-2212-4a93-ab8b-3ec3dc61eb87 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:37:50.022828 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f9ca9ef1-2212-4a93-ab8b-3ec3dc61eb87 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:50.023357 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f9ca9ef1-2212-4a93-ab8b-3ec3dc61eb87 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:50.024241 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f9ca9ef1-2212-4a93-ab8b-3ec3dc61eb87 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:50.024676 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-f9ca9ef1-2212-4a93-ab8b-3ec3dc61eb87 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:50.038441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-f9ca9ef1-2212-4a93-ab8b-3ec3dc61eb87 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] HTTP exception thrown: Instance c73f173b-bae7-44a2-b686-0179e64e9c30 could not be found. Feb 08 17:37:50.039029 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-f9ca9ef1-2212-4a93-ab8b-3ec3dc61eb87 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Returning 404 to user: Instance c73f173b-bae7-44a2-b686-0179e64e9c30 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:37:50.039846 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-f9ca9ef1-2212-4a93-ab8b-3ec3dc61eb87 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 404 len: 111 microversion: 2.20 time: 0.027781 Feb 08 17:37:50.040383 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 487/999] 10.222.0.69 () {60 vars in 1279 bytes} [Tue Feb 8 17:37:50 2022] DELETE /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 08 17:37:50.048255 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b4f7cbca-4c57-4761-b25d-faade15baac4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:50.048872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-b4f7cbca-4c57-4761-b25d-faade15baac4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] [instance: c73f173b-bae7-44a2-b686-0179e64e9c30] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:37:50.056111 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b4f7cbca-4c57-4761-b25d-faade15baac4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:50.056558 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b4f7cbca-4c57-4761-b25d-faade15baac4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:50.057388 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b4f7cbca-4c57-4761-b25d-faade15baac4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:37:50.057820 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b4f7cbca-4c57-4761-b25d-faade15baac4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:37:50.071749 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-b4f7cbca-4c57-4761-b25d-faade15baac4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] HTTP exception thrown: Instance c73f173b-bae7-44a2-b686-0179e64e9c30 could not be found. Feb 08 17:37:50.072331 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b4f7cbca-4c57-4761-b25d-faade15baac4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] Returning 404 to user: Instance c73f173b-bae7-44a2-b686-0179e64e9c30 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:37:50.073151 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b4f7cbca-4c57-4761-b25d-faade15baac4 tempest-AttachVolumeShelveTestJSON-590044493 tempest-AttachVolumeShelveTestJSON-590044493-project] 10.222.0.69 "GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30" status: 404 len: 111 microversion: 2.20 time: 0.028686 Feb 08 17:37:50.073742 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 513/1000] 10.222.0.69 () {60 vars in 1276 bytes} [Tue Feb 8 17:37:50 2022] GET /compute/v2.1/servers/c73f173b-bae7-44a2-b686-0179e64e9c30 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 08 17:37:54.650253 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-63c6c5f2-8d44-472b-8d92-387f17d430b5 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Action: 'create', calling method: .version_select at 0x7fd9f9820040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1121535595"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:37:54.932855 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-63c6c5f2-8d44-472b-8d92-387f17d430b5 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.397100 Feb 08 17:37:54.933519 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 488/1001] 10.222.0.69 () {60 vars in 1154 bytes} [Tue Feb 8 17:37:54 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 399 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 08 17:37:54.944681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e44c36c0-7c60-4944-88fb-3a19f3a57cfc tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9fa1ad280>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:54.992302 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e44c36c0-7c60-4944-88fb-3a19f3a57cfc tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7" status: 200 len: 345 microversion: 2.1 time: 0.051795 Feb 08 17:37:54.992906 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 514/1002] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:37:54 2022] GET /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:37:56.005632 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-521d9828-d9ac-4f4c-af49-c12e395c313e tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9f97d3f70>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:56.052498 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-521d9828-d9ac-4f4c-af49-c12e395c313e tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7" status: 200 len: 346 microversion: 2.1 time: 0.050926 Feb 08 17:37:56.053072 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 489/1003] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:37:56 2022] GET /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:37:56.064741 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-fd45b9c8-8091-4dcf-a0bd-a7c837ba5932 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Action: 'create', calling method: .version_select at 0x7fd9fa249dc0>, body: {"snapshot": {"volume_id": "7ee97daa-4e11-4754-877e-05ee442f4ae7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-964130524"}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:37:56.205293 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-fd45b9c8-8091-4dcf-a0bd-a7c837ba5932 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.145121 Feb 08 17:37:56.206219 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 515/1004] 10.222.0.69 () {60 vars in 1161 bytes} [Tue Feb 8 17:37:56 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:37:56.215735 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5b590340-adff-4d1b-af1a-d2b0763f5293 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9f98a8790>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:56.247153 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5b590340-adff-4d1b-af1a-d2b0763f5293 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd" status: 200 len: 286 microversion: 2.1 time: 0.034840 Feb 08 17:37:56.247797 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 490/1005] 10.222.0.69 () {58 vars in 1250 bytes} [Tue Feb 8 17:37:56 2022] GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:37:56.257989 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ea5ce7aa-50bc-48e4-9af3-e6fe5575421b tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9fa20f0d0>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:56.286723 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ea5ce7aa-50bc-48e4-9af3-e6fe5575421b tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032442 Feb 08 17:37:56.287282 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 516/1006] 10.222.0.69 () {58 vars in 1139 bytes} [Tue Feb 8 17:37:56 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:37:56.297031 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-122988ec-c98f-4a2a-8efc-ae7571db99f6 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9f97d3550>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:56.325930 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-122988ec-c98f-4a2a-8efc-ae7571db99f6 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd" status: 200 len: 286 microversion: 2.1 time: 0.032533 Feb 08 17:37:56.326501 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 491/1007] 10.222.0.69 () {58 vars in 1250 bytes} [Tue Feb 8 17:37:56 2022] GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:37:57.337345 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-025d5efc-eb43-4c7e-b384-3e14cde2a838 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9f9f22b80>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:57.366270 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-025d5efc-eb43-4c7e-b384-3e14cde2a838 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd" status: 200 len: 286 microversion: 2.1 time: 0.033026 Feb 08 17:37:57.366839 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 517/1008] 10.222.0.69 () {58 vars in 1250 bytes} [Tue Feb 8 17:37:57 2022] GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:37:58.378416 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-072a0190-2f48-4016-b129-3e4dff00ca89 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9f9887b80>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:58.407694 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-072a0190-2f48-4016-b129-3e4dff00ca89 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd" status: 200 len: 286 microversion: 2.1 time: 0.033364 Feb 08 17:37:58.408272 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 492/1009] 10.222.0.69 () {58 vars in 1250 bytes} [Tue Feb 8 17:37:58 2022] GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:37:59.420155 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-821b7272-2119-43c4-a246-d077a9fff1ea tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9fa12da60>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:59.447830 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-821b7272-2119-43c4-a246-d077a9fff1ea tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd" status: 200 len: 287 microversion: 2.1 time: 0.031718 Feb 08 17:37:59.448392 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 518/1010] 10.222.0.69 () {58 vars in 1250 bytes} [Tue Feb 8 17:37:59 2022] GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:37:59.459409 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-fa4ce68c-5e90-4a20-ba73-d0840059ce77 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9f9887310>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:59.512520 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-fa4ce68c-5e90-4a20-ba73-d0840059ce77 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd" status: 202 len: 0 microversion: 2.1 time: 0.057554 Feb 08 17:37:59.513929 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 493/1011] 10.222.0.69 () {58 vars in 1253 bytes} [Tue Feb 8 17:37:59 2022] DELETE /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:37:59.522945 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d2768611-bfc7-4caf-a85b-52c34cb86a0c tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9fa26db80>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:37:59.552542 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d2768611-bfc7-4caf-a85b-52c34cb86a0c tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd" status: 200 len: 286 microversion: 2.1 time: 0.033688 Feb 08 17:37:59.553148 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 519/1012] 10.222.0.69 () {58 vars in 1250 bytes} [Tue Feb 8 17:37:59 2022] GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:38:00.564463 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-44cdbdef-d378-44d8-92ad-e4c1512d2c39 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9f98bb790>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:00.587798 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-44cdbdef-d378-44d8-92ad-e4c1512d2c39 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] HTTP exception thrown: Snapshot adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd could not be found. Feb 08 17:38:00.588044 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-44cdbdef-d378-44d8-92ad-e4c1512d2c39 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Returning 404 to user: Snapshot adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:38:00.589002 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-44cdbdef-d378-44d8-92ad-e4c1512d2c39 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd" status: 404 len: 111 microversion: 2.1 time: 0.028563 Feb 08 17:38:00.589456 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 494/1013] 10.222.0.69 () {58 vars in 1250 bytes} [Tue Feb 8 17:38:00 2022] GET /compute/v2.1/os-snapshots/adbfe3f6-9fd8-4f36-bdd1-e275c9fa63bd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:38:00.598893 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c816de9b-97b9-42db-9a9f-8dd81889ad40 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9fa2361f0>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:00.659906 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c816de9b-97b9-42db-9a9f-8dd81889ad40 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7" status: 202 len: 0 microversion: 2.1 time: 0.065087 Feb 08 17:38:00.660847 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 520/1014] 10.222.0.69 () {58 vars in 1247 bytes} [Tue Feb 8 17:38:00 2022] DELETE /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:38:00.671187 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ac55976d-1e9b-4df8-a560-c1e10e0715c5 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9f98a8280>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:00.727172 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ac55976d-1e9b-4df8-a560-c1e10e0715c5 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7" status: 200 len: 345 microversion: 2.1 time: 0.059556 Feb 08 17:38:00.727763 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 495/1015] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:38:00 2022] GET /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:38:01.741003 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c5314ca1-9c7c-4276-aadd-4fc5b437fed0 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9fa20fca0>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:01.768614 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-c5314ca1-9c7c-4276-aadd-4fc5b437fed0 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] HTTP exception thrown: Volume 7ee97daa-4e11-4754-877e-05ee442f4ae7 could not be found. Feb 08 17:38:01.769281 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c5314ca1-9c7c-4276-aadd-4fc5b437fed0 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Returning 404 to user: Volume 7ee97daa-4e11-4754-877e-05ee442f4ae7 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:38:01.770116 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c5314ca1-9c7c-4276-aadd-4fc5b437fed0 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7" status: 404 len: 109 microversion: 2.1 time: 0.033990 Feb 08 17:38:01.770687 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 521/1016] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:38:01 2022] GET /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:38:01.780544 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2274f08e-d02d-4fbe-bc08-2b091f5d3c97 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9f9887b80>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:01.808689 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-2274f08e-d02d-4fbe-bc08-2b091f5d3c97 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] HTTP exception thrown: Volume 7ee97daa-4e11-4754-877e-05ee442f4ae7 could not be found. Feb 08 17:38:01.809340 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2274f08e-d02d-4fbe-bc08-2b091f5d3c97 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Returning 404 to user: Volume 7ee97daa-4e11-4754-877e-05ee442f4ae7 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:38:01.810162 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2274f08e-d02d-4fbe-bc08-2b091f5d3c97 tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7" status: 404 len: 109 microversion: 2.1 time: 0.034049 Feb 08 17:38:01.810704 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 496/1017] 10.222.0.69 () {58 vars in 1247 bytes} [Tue Feb 8 17:38:01 2022] DELETE /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:38:01.819066 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-db9c8889-805f-4f2b-a557-8d406a242e8e tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Calling method '.version_select at 0x7fd9fa24fee0>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:01.844264 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-db9c8889-805f-4f2b-a557-8d406a242e8e tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] HTTP exception thrown: Volume 7ee97daa-4e11-4754-877e-05ee442f4ae7 could not be found. Feb 08 17:38:01.844851 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-db9c8889-805f-4f2b-a557-8d406a242e8e tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] Returning 404 to user: Volume 7ee97daa-4e11-4754-877e-05ee442f4ae7 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:38:01.845710 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-db9c8889-805f-4f2b-a557-8d406a242e8e tempest-VolumesSnapshotsTestJSON-199378833 tempest-VolumesSnapshotsTestJSON-199378833-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7" status: 404 len: 109 microversion: 2.1 time: 0.030969 Feb 08 17:38:01.846245 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 522/1018] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:38:01 2022] GET /compute/v2.1/os-volumes/7ee97daa-4e11-4754-877e-05ee442f4ae7 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:38:03.228757 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-faebb256-3270-44e5-975a-6d595c478b0a tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Action: 'create', calling method: .version_select at 0x7fd9f98625e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1962127015", "metadata": {"Type": "work"}}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:38:03.230322 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-faebb256-3270-44e5-975a-6d595c478b0a tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:38:03.231160 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-faebb256-3270-44e5-975a-6d595c478b0a tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.120007 Feb 08 17:38:03.231729 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 497/1019] 10.222.0.69 () {60 vars in 1155 bytes} [Tue Feb 8 17:38:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 08 17:38:03.242639 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-71d4b878-8afd-4ef6-8787-7b9ba73a6168 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Action: 'create', calling method: .version_select at 0x7fd9fa225280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-898112393", "metadata": {"Type": "work"}}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:38:03.244044 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-71d4b878-8afd-4ef6-8787-7b9ba73a6168 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:38:03.244892 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-71d4b878-8afd-4ef6-8787-7b9ba73a6168 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007937 Feb 08 17:38:03.245714 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 523/1020] 10.222.0.69 () {60 vars in 1155 bytes} [Tue Feb 8 17:38:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 08 17:38:03.255111 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cfb1512a-2046-4a41-bb00-d2cfc288eaa1 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Action: 'create', calling method: .version_select at 0x7fd9f9887c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1370970002", "metadata": {"Type": "work"}}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:38:03.256256 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-cfb1512a-2046-4a41-bb00-d2cfc288eaa1 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:38:03.257042 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-cfb1512a-2046-4a41-bb00-d2cfc288eaa1 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006101 Feb 08 17:38:03.257575 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 498/1021] 10.222.0.69 () {60 vars in 1155 bytes} [Tue Feb 8 17:38:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 08 17:38:03.266050 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-516c181b-afe9-4f68-a45e-cdd638b9cfb7 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Calling method '.version_select at 0x7fd9fa24fee0>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:03.293470 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-516c181b-afe9-4f68-a45e-cdd638b9cfb7 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] HTTP exception thrown: Volume tempest-invalid-1811172637 could not be found. Feb 08 17:38:03.294069 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-516c181b-afe9-4f68-a45e-cdd638b9cfb7 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Returning 404 to user: Volume tempest-invalid-1811172637 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:38:03.294902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-516c181b-afe9-4f68-a45e-cdd638b9cfb7 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1811172637" status: 404 len: 99 microversion: 2.1 time: 0.032528 Feb 08 17:38:03.295458 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 524/1022] 10.222.0.69 () {58 vars in 1217 bytes} [Tue Feb 8 17:38:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1811172637 => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 08 17:38:03.305003 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e0df2f11-8769-4466-99e9-7be224ae23fe tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003549 Feb 08 17:38:03.305539 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 499/1023] 10.222.0.69 () {58 vars in 1139 bytes} [Tue Feb 8 17:38:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 08 17:38:03.316916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-90bf4054-4f72-420b-af86-657fd075c2e9 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006771 Feb 08 17:38:03.317481 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 525/1024] 10.222.0.69 () {58 vars in 1136 bytes} [Tue Feb 8 17:38:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 08 17:38:03.326463 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-05bf98e4-65af-411b-bc83-c95a36f0dfc2 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Calling method '.version_select at 0x7fd9f9815700>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:03.353582 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-05bf98e4-65af-411b-bc83-c95a36f0dfc2 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] HTTP exception thrown: Volume d0ac96f3-04f1-4553-aeb4-3151d2fe574c could not be found. Feb 08 17:38:03.353984 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-05bf98e4-65af-411b-bc83-c95a36f0dfc2 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Returning 404 to user: Volume d0ac96f3-04f1-4553-aeb4-3151d2fe574c could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:38:03.354799 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-05bf98e4-65af-411b-bc83-c95a36f0dfc2 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/d0ac96f3-04f1-4553-aeb4-3151d2fe574c" status: 404 len: 109 microversion: 2.1 time: 0.031955 Feb 08 17:38:03.355345 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 500/1025] 10.222.0.69 () {58 vars in 1247 bytes} [Tue Feb 8 17:38:03 2022] DELETE /compute/v2.1/os-volumes/d0ac96f3-04f1-4553-aeb4-3151d2fe574c => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:38:03.365055 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-250cf881-7fd2-4488-8c92-8dbd0b85f3f3 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Calling method '.version_select at 0x7fd9fa2250d0>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:03.391108 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-250cf881-7fd2-4488-8c92-8dbd0b85f3f3 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] HTTP exception thrown: Volume 22651b39-b63e-4783-ada3-80783564fbc9 could not be found. Feb 08 17:38:03.391701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-250cf881-7fd2-4488-8c92-8dbd0b85f3f3 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] Returning 404 to user: Volume 22651b39-b63e-4783-ada3-80783564fbc9 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:38:03.392529 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-250cf881-7fd2-4488-8c92-8dbd0b85f3f3 tempest-VolumesNegativeTest-41898305 tempest-VolumesNegativeTest-41898305-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/22651b39-b63e-4783-ada3-80783564fbc9" status: 404 len: 109 microversion: 2.1 time: 0.032039 Feb 08 17:38:03.393076 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 526/1026] 10.222.0.69 () {58 vars in 1244 bytes} [Tue Feb 8 17:38:03 2022] GET /compute/v2.1/os-volumes/22651b39-b63e-4783-ada3-80783564fbc9 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:38:24.769423 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:38:24.770043 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: Tue Feb 8 17:38:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:38:44.724331 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-fe8e4797-5df7-4ba9-b1b4-c3e28e6c32a2 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:38:44.725002 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-fe8e4797-5df7-4ba9-b1b4-c3e28e6c32a2 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:44.731627 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe8e4797-5df7-4ba9-b1b4-c3e28e6c32a2 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:44.732072 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe8e4797-5df7-4ba9-b1b4-c3e28e6c32a2 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:44.732858 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe8e4797-5df7-4ba9-b1b4-c3e28e6c32a2 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:44.733316 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe8e4797-5df7-4ba9-b1b4-c3e28e6c32a2 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:44.756375 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-fe8e4797-5df7-4ba9-b1b4-c3e28e6c32a2 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lazy-loading 'flavor' on Instance uuid 8692ef30-50d2-43bc-84ad-1d7308a694cf {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:38:44.836551 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-fe8e4797-5df7-4ba9-b1b4-c3e28e6c32a2 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "POST /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf/action" status: 202 len: 0 microversion: 2.1 time: 0.116193 Feb 08 17:38:44.837245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 501/1027] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:38:44 2022] POST /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:38:44.847789 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d2a34d67-f4ae-438d-8117-bf5057872848 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:44.848461 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d2a34d67-f4ae-438d-8117-bf5057872848 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:44.856912 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2a34d67-f4ae-438d-8117-bf5057872848 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:44.857751 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2a34d67-f4ae-438d-8117-bf5057872848 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:44.859307 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2a34d67-f4ae-438d-8117-bf5057872848 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:44.860219 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d2a34d67-f4ae-438d-8117-bf5057872848 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:45.249024 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d2a34d67-f4ae-438d-8117-bf5057872848 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:45.257081 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d2a34d67-f4ae-438d-8117-bf5057872848 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.414608 Feb 08 17:38:45.257713 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 527/1028] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:44 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:46.276276 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1e53eb40-3d45-4aea-8126-b021baefacbd tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:46.276993 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1e53eb40-3d45-4aea-8126-b021baefacbd tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:46.283702 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1e53eb40-3d45-4aea-8126-b021baefacbd tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:46.284097 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1e53eb40-3d45-4aea-8126-b021baefacbd tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:46.284900 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1e53eb40-3d45-4aea-8126-b021baefacbd tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:46.285375 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1e53eb40-3d45-4aea-8126-b021baefacbd tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:46.497574 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1e53eb40-3d45-4aea-8126-b021baefacbd tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:46.505831 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1e53eb40-3d45-4aea-8126-b021baefacbd tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.234052 Feb 08 17:38:46.506401 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 502/1029] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:46 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:47.522745 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-25888f49-0274-4a26-96bc-45957f956e08 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:47.523358 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-25888f49-0274-4a26-96bc-45957f956e08 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:47.530620 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25888f49-0274-4a26-96bc-45957f956e08 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:47.531069 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25888f49-0274-4a26-96bc-45957f956e08 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:47.531872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25888f49-0274-4a26-96bc-45957f956e08 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:47.532307 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-25888f49-0274-4a26-96bc-45957f956e08 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:47.671821 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-25888f49-0274-4a26-96bc-45957f956e08 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:47.679545 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-25888f49-0274-4a26-96bc-45957f956e08 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.161038 Feb 08 17:38:47.680113 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 528/1030] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:47 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:48.695872 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e47a6958-3525-427f-b408-aebde2a36d01 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:48.696603 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-e47a6958-3525-427f-b408-aebde2a36d01 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:48.703313 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e47a6958-3525-427f-b408-aebde2a36d01 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:48.703794 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e47a6958-3525-427f-b408-aebde2a36d01 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:48.704613 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e47a6958-3525-427f-b408-aebde2a36d01 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:48.705049 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e47a6958-3525-427f-b408-aebde2a36d01 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:48.849341 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e47a6958-3525-427f-b408-aebde2a36d01 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:48.857853 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e47a6958-3525-427f-b408-aebde2a36d01 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.165699 Feb 08 17:38:48.858443 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 503/1031] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:48 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:49.875722 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3155aaf7-6af6-4865-8370-bb129aa08754 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:49.876322 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3155aaf7-6af6-4865-8370-bb129aa08754 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:49.882745 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3155aaf7-6af6-4865-8370-bb129aa08754 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:49.883192 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3155aaf7-6af6-4865-8370-bb129aa08754 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:49.883980 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3155aaf7-6af6-4865-8370-bb129aa08754 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:49.884419 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3155aaf7-6af6-4865-8370-bb129aa08754 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:50.025050 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-3155aaf7-6af6-4865-8370-bb129aa08754 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:50.032672 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3155aaf7-6af6-4865-8370-bb129aa08754 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.160640 Feb 08 17:38:50.033404 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 529/1032] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:49 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:51.050476 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-123f52b1-722b-496f-8f8c-070913393dfa tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:51.051086 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-123f52b1-722b-496f-8f8c-070913393dfa tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:51.057617 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-123f52b1-722b-496f-8f8c-070913393dfa tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:51.058059 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-123f52b1-722b-496f-8f8c-070913393dfa tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:51.058834 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-123f52b1-722b-496f-8f8c-070913393dfa tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:51.059265 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-123f52b1-722b-496f-8f8c-070913393dfa tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:51.203073 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-123f52b1-722b-496f-8f8c-070913393dfa tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:51.211154 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-123f52b1-722b-496f-8f8c-070913393dfa tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.164366 Feb 08 17:38:51.211730 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 504/1033] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:51 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:52.233717 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c678d8dd-0845-4ae5-b55f-9f041a1e46c6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:52.234318 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c678d8dd-0845-4ae5-b55f-9f041a1e46c6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:52.241714 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c678d8dd-0845-4ae5-b55f-9f041a1e46c6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:52.242168 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c678d8dd-0845-4ae5-b55f-9f041a1e46c6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:52.242976 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c678d8dd-0845-4ae5-b55f-9f041a1e46c6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:52.243411 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c678d8dd-0845-4ae5-b55f-9f041a1e46c6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:52.383793 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-c678d8dd-0845-4ae5-b55f-9f041a1e46c6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:52.391301 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c678d8dd-0845-4ae5-b55f-9f041a1e46c6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.161298 Feb 08 17:38:52.391858 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 530/1034] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:52 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:53.407970 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-42ca514d-f7f1-4e8e-b46f-b0e6faaa2692 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:53.408566 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-42ca514d-f7f1-4e8e-b46f-b0e6faaa2692 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:53.415417 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42ca514d-f7f1-4e8e-b46f-b0e6faaa2692 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:53.415858 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42ca514d-f7f1-4e8e-b46f-b0e6faaa2692 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:53.416644 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42ca514d-f7f1-4e8e-b46f-b0e6faaa2692 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:53.417076 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-42ca514d-f7f1-4e8e-b46f-b0e6faaa2692 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:53.552850 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-42ca514d-f7f1-4e8e-b46f-b0e6faaa2692 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:53.560226 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-42ca514d-f7f1-4e8e-b46f-b0e6faaa2692 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.155926 Feb 08 17:38:53.560794 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 505/1035] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:53 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:54.576708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-bfb672a2-d506-42ae-be8d-a0f342cf4b52 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:54.577349 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-bfb672a2-d506-42ae-be8d-a0f342cf4b52 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:54.584207 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfb672a2-d506-42ae-be8d-a0f342cf4b52 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:54.584656 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfb672a2-d506-42ae-be8d-a0f342cf4b52 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:54.585482 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfb672a2-d506-42ae-be8d-a0f342cf4b52 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:54.585923 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-bfb672a2-d506-42ae-be8d-a0f342cf4b52 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:54.723631 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-bfb672a2-d506-42ae-be8d-a0f342cf4b52 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:54.731190 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-bfb672a2-d506-42ae-be8d-a0f342cf4b52 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.158136 Feb 08 17:38:54.731753 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 531/1036] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:54 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:55.748347 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2176be4d-3869-4ff7-ba74-d21122ba4b97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:55.748962 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2176be4d-3869-4ff7-ba74-d21122ba4b97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:55.755914 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2176be4d-3869-4ff7-ba74-d21122ba4b97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:55.756360 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2176be4d-3869-4ff7-ba74-d21122ba4b97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:55.757178 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2176be4d-3869-4ff7-ba74-d21122ba4b97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:55.757622 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2176be4d-3869-4ff7-ba74-d21122ba4b97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:55.904985 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2176be4d-3869-4ff7-ba74-d21122ba4b97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:55.913567 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2176be4d-3869-4ff7-ba74-d21122ba4b97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.168956 Feb 08 17:38:55.914147 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 506/1037] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:55 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:56.930876 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-059b7ed4-a881-4d34-8331-ae25a493dc09 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:56.931483 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-059b7ed4-a881-4d34-8331-ae25a493dc09 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:56.938149 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-059b7ed4-a881-4d34-8331-ae25a493dc09 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:56.938591 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-059b7ed4-a881-4d34-8331-ae25a493dc09 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:56.939448 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-059b7ed4-a881-4d34-8331-ae25a493dc09 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:56.939809 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-059b7ed4-a881-4d34-8331-ae25a493dc09 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:57.086513 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-059b7ed4-a881-4d34-8331-ae25a493dc09 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:57.093971 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-059b7ed4-a881-4d34-8331-ae25a493dc09 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.166774 Feb 08 17:38:57.094539 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 532/1038] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:56 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:58.110869 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d493ca2e-6103-41e0-bd33-7feb8390dc77 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:58.111477 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d493ca2e-6103-41e0-bd33-7feb8390dc77 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:58.118188 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d493ca2e-6103-41e0-bd33-7feb8390dc77 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:58.118640 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d493ca2e-6103-41e0-bd33-7feb8390dc77 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:58.119425 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d493ca2e-6103-41e0-bd33-7feb8390dc77 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:58.119867 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d493ca2e-6103-41e0-bd33-7feb8390dc77 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:58.258211 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d493ca2e-6103-41e0-bd33-7feb8390dc77 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:58.265603 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d493ca2e-6103-41e0-bd33-7feb8390dc77 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1508 microversion: 2.1 time: 0.158403 Feb 08 17:38:58.266174 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 507/1039] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:58 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:58.282254 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-5a3720cd-1ff2-468d-a246-62928399d898 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:38:58.282849 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-5a3720cd-1ff2-468d-a246-62928399d898 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:58.289216 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5a3720cd-1ff2-468d-a246-62928399d898 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:58.289747 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5a3720cd-1ff2-468d-a246-62928399d898 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:58.290560 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5a3720cd-1ff2-468d-a246-62928399d898 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:58.290985 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-5a3720cd-1ff2-468d-a246-62928399d898 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:58.367046 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-5a3720cd-1ff2-468d-a246-62928399d898 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "POST /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf/action" status: 202 len: 0 microversion: 2.1 time: 0.088508 Feb 08 17:38:58.367659 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 533/1040] 10.222.0.69 () {60 vars in 1277 bytes} [Tue Feb 8 17:38:58 2022] POST /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:38:58.375717 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6813fbee-dc64-49be-8583-260c2cec781f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:58.376333 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6813fbee-dc64-49be-8583-260c2cec781f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:58.382859 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6813fbee-dc64-49be-8583-260c2cec781f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:58.383331 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6813fbee-dc64-49be-8583-260c2cec781f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:58.384111 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6813fbee-dc64-49be-8583-260c2cec781f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:58.384549 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6813fbee-dc64-49be-8583-260c2cec781f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:58.527981 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6813fbee-dc64-49be-8583-260c2cec781f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:58.535465 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6813fbee-dc64-49be-8583-260c2cec781f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1516 microversion: 2.1 time: 0.163412 Feb 08 17:38:58.536032 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 508/1041] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:58 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:38:59.553329 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-63db1234-3c92-4728-a0df-40363d5f5d97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:38:59.554103 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-63db1234-3c92-4728-a0df-40363d5f5d97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:38:59.561060 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-63db1234-3c92-4728-a0df-40363d5f5d97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:59.561539 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-63db1234-3c92-4728-a0df-40363d5f5d97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:59.562332 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-63db1234-3c92-4728-a0df-40363d5f5d97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:38:59.562766 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-63db1234-3c92-4728-a0df-40363d5f5d97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:38:59.712577 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-63db1234-3c92-4728-a0df-40363d5f5d97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:38:59.722617 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-63db1234-3c92-4728-a0df-40363d5f5d97 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1518 microversion: 2.1 time: 0.173467 Feb 08 17:38:59.723203 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 534/1042] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:38:59 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:39:00.741018 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ac15c41b-023f-4825-b2cf-02fb5034043c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:39:00.741956 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ac15c41b-023f-4825-b2cf-02fb5034043c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:39:00.748962 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ac15c41b-023f-4825-b2cf-02fb5034043c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:00.749524 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ac15c41b-023f-4825-b2cf-02fb5034043c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:00.750311 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ac15c41b-023f-4825-b2cf-02fb5034043c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:00.750748 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-ac15c41b-023f-4825-b2cf-02fb5034043c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:00.888366 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ac15c41b-023f-4825-b2cf-02fb5034043c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:39:00.896594 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ac15c41b-023f-4825-b2cf-02fb5034043c tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1574 microversion: 2.1 time: 0.159365 Feb 08 17:39:00.896594 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 509/1043] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:39:00 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:39:01.912722 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-54c61ecc-6bd7-441a-979d-a91fff964c88 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:39:01.913442 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-54c61ecc-6bd7-441a-979d-a91fff964c88 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:39:01.919704 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-54c61ecc-6bd7-441a-979d-a91fff964c88 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:01.920157 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-54c61ecc-6bd7-441a-979d-a91fff964c88 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:01.920947 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-54c61ecc-6bd7-441a-979d-a91fff964c88 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:01.921413 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-54c61ecc-6bd7-441a-979d-a91fff964c88 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:02.061914 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-54c61ecc-6bd7-441a-979d-a91fff964c88 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:39:02.069894 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-54c61ecc-6bd7-441a-979d-a91fff964c88 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1574 microversion: 2.1 time: 0.160824 Feb 08 17:39:02.070473 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 535/1044] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:39:01 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:39:02.240658 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-9a13aa76-2eab-42dd-8f9c-761b8dd68371 req-63c60a95-4a19-48b0-bc98-77682ff688eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8692ef30-50d2-43bc-84ad-1d7308a694cf", "name": "network-vif-unplugged", "status": "completed", "tag": "cf060131-592b-49f3-bed4-02a89d544e1f"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:39:02.242323 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:39:02.242323 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:39:02.249135 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-9a13aa76-2eab-42dd-8f9c-761b8dd68371 req-63c60a95-4a19-48b0-bc98-77682ff688eb service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:02.249614 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-9a13aa76-2eab-42dd-8f9c-761b8dd68371 req-63c60a95-4a19-48b0-bc98-77682ff688eb service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:02.263571 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-9a13aa76-2eab-42dd-8f9c-761b8dd68371 req-63c60a95-4a19-48b0-bc98-77682ff688eb service nova] Creating event network-vif-unplugged:cf060131-592b-49f3-bed4-02a89d544e1f for instance 8692ef30-50d2-43bc-84ad-1d7308a694cf on hv-cinder-82204 Feb 08 17:39:02.269318 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-9a13aa76-2eab-42dd-8f9c-761b8dd68371 req-63c60a95-4a19-48b0-bc98-77682ff688eb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096119 Feb 08 17:39:02.270594 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 510/1045] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:39:03.086703 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-210f7a7f-4e67-434b-a004-739e4fed95d0 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:39:03.087341 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-210f7a7f-4e67-434b-a004-739e4fed95d0 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:39:03.093525 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-210f7a7f-4e67-434b-a004-739e4fed95d0 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:03.093965 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-210f7a7f-4e67-434b-a004-739e4fed95d0 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:03.094735 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-210f7a7f-4e67-434b-a004-739e4fed95d0 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:03.095190 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-210f7a7f-4e67-434b-a004-739e4fed95d0 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:03.229306 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-210f7a7f-4e67-434b-a004-739e4fed95d0 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:39:03.236802 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-210f7a7f-4e67-434b-a004-739e4fed95d0 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1574 microversion: 2.1 time: 0.153737 Feb 08 17:39:03.238151 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 536/1046] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:39:03 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:39:04.255509 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e703a7b8-11ce-4184-a9e2-53819ce219c8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:39:04.256204 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-e703a7b8-11ce-4184-a9e2-53819ce219c8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:39:04.262817 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e703a7b8-11ce-4184-a9e2-53819ce219c8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:04.263267 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e703a7b8-11ce-4184-a9e2-53819ce219c8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:04.264055 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e703a7b8-11ce-4184-a9e2-53819ce219c8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:04.264490 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e703a7b8-11ce-4184-a9e2-53819ce219c8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:04.405646 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e703a7b8-11ce-4184-a9e2-53819ce219c8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:39:04.413818 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e703a7b8-11ce-4184-a9e2-53819ce219c8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1574 microversion: 2.1 time: 0.162323 Feb 08 17:39:04.414394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 511/1047] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:39:04 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:39:05.431383 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-62b3c255-317b-4c43-93ce-6088bd300ebf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:39:05.432003 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-62b3c255-317b-4c43-93ce-6088bd300ebf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:39:05.437985 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-62b3c255-317b-4c43-93ce-6088bd300ebf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:05.438437 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-62b3c255-317b-4c43-93ce-6088bd300ebf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:05.439225 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-62b3c255-317b-4c43-93ce-6088bd300ebf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:05.439663 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-62b3c255-317b-4c43-93ce-6088bd300ebf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:05.580280 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-62b3c255-317b-4c43-93ce-6088bd300ebf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:39:05.587692 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-62b3c255-317b-4c43-93ce-6088bd300ebf tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1574 microversion: 2.1 time: 0.160218 Feb 08 17:39:05.588260 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 537/1048] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:39:05 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:39:06.606373 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-efe849be-24e2-448f-8782-954363ab0129 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:39:06.606943 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-efe849be-24e2-448f-8782-954363ab0129 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:39:06.613884 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-efe849be-24e2-448f-8782-954363ab0129 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:06.614336 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-efe849be-24e2-448f-8782-954363ab0129 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:06.615415 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-efe849be-24e2-448f-8782-954363ab0129 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:06.615863 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-efe849be-24e2-448f-8782-954363ab0129 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:06.785826 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-efe849be-24e2-448f-8782-954363ab0129 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:39:06.798453 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-efe849be-24e2-448f-8782-954363ab0129 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1574 microversion: 2.1 time: 0.196028 Feb 08 17:39:06.799043 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 512/1049] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:39:06 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1574 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:39:07.816460 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-43974c38-c046-4507-8b27-d052e9172f76 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:39:07.817068 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-43974c38-c046-4507-8b27-d052e9172f76 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:39:07.823461 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43974c38-c046-4507-8b27-d052e9172f76 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:07.823920 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43974c38-c046-4507-8b27-d052e9172f76 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:07.824709 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43974c38-c046-4507-8b27-d052e9172f76 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:07.825148 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-43974c38-c046-4507-8b27-d052e9172f76 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:07.966848 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-43974c38-c046-4507-8b27-d052e9172f76 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:39:07.975330 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-43974c38-c046-4507-8b27-d052e9172f76 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1561 microversion: 2.1 time: 0.163086 Feb 08 17:39:07.975937 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 538/1050] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:39:07 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:39:10.256491 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-049f42c5-8a73-4c7b-8ad8-1ea83c034d3b req-bac38f61-1d82-4e45-b953-ed36bc23b3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8692ef30-50d2-43bc-84ad-1d7308a694cf", "name": "network-vif-plugged", "status": "completed", "tag": "cf060131-592b-49f3-bed4-02a89d544e1f"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:39:10.258246 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:39:10.258246 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:39:10.266530 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-049f42c5-8a73-4c7b-8ad8-1ea83c034d3b req-bac38f61-1d82-4e45-b953-ed36bc23b3a3 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:39:10.266983 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-049f42c5-8a73-4c7b-8ad8-1ea83c034d3b req-bac38f61-1d82-4e45-b953-ed36bc23b3a3 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:39:10.279763 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-049f42c5-8a73-4c7b-8ad8-1ea83c034d3b req-bac38f61-1d82-4e45-b953-ed36bc23b3a3 service nova] Creating event network-vif-plugged:cf060131-592b-49f3-bed4-02a89d544e1f for instance 8692ef30-50d2-43bc-84ad-1d7308a694cf on hv-cinder-82204 Feb 08 17:39:10.285889 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-049f42c5-8a73-4c7b-8ad8-1ea83c034d3b req-bac38f61-1d82-4e45-b953-ed36bc23b3a3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032873 Feb 08 17:39:10.286725 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 513/1051] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:40:15.940130 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:40:15.940758 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: Tue Feb 8 17:40:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:40:25.930472 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-ce4bf35f-b865-4d7e-b559-9a3c8ed9a3f6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:40:25.931167 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ce4bf35f-b865-4d7e-b559-9a3c8ed9a3f6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:40:25.940731 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ce4bf35f-b865-4d7e-b559-9a3c8ed9a3f6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:25.941272 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ce4bf35f-b865-4d7e-b559-9a3c8ed9a3f6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:25.942154 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ce4bf35f-b865-4d7e-b559-9a3c8ed9a3f6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:25.942922 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-ce4bf35f-b865-4d7e-b559-9a3c8ed9a3f6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:25.974153 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-ce4bf35f-b865-4d7e-b559-9a3c8ed9a3f6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:40:25.995367 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-1baccc56-7211-4b44-87d2-619742218b87 req-1f243477-8ab4-46e8-8681-adfd3e91773a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8692ef30-50d2-43bc-84ad-1d7308a694cf", "tag": "cf060131-592b-49f3-bed4-02a89d544e1f"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:40:25.997034 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:40:25.997034 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:40:26.005215 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-1baccc56-7211-4b44-87d2-619742218b87 req-1f243477-8ab4-46e8-8681-adfd3e91773a service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:26.005451 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-1baccc56-7211-4b44-87d2-619742218b87 req-1f243477-8ab4-46e8-8681-adfd3e91773a service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:26.017268 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-1baccc56-7211-4b44-87d2-619742218b87 req-1f243477-8ab4-46e8-8681-adfd3e91773a service nova] Creating event network-changed:cf060131-592b-49f3-bed4-02a89d544e1f for instance 8692ef30-50d2-43bc-84ad-1d7308a694cf on hv-cinder-82204 Feb 08 17:40:26.023896 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-1baccc56-7211-4b44-87d2-619742218b87 req-1f243477-8ab4-46e8-8681-adfd3e91773a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096300 Feb 08 17:40:26.026103 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 514/1052] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:40:26.073810 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-ce4bf35f-b865-4d7e-b559-9a3c8ed9a3f6 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 204 len: 0 microversion: 2.1 time: 0.148573 Feb 08 17:40:26.074594 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 539/1053] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:40:25 2022] DELETE /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:40:26.087376 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1b14441c-00b1-43a6-8603-cb6eea7495ec tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:40:26.088793 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1b14441c-00b1-43a6-8603-cb6eea7495ec tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:40:26.101823 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1b14441c-00b1-43a6-8603-cb6eea7495ec tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:26.101823 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1b14441c-00b1-43a6-8603-cb6eea7495ec tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:26.102696 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1b14441c-00b1-43a6-8603-cb6eea7495ec tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:26.104769 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1b14441c-00b1-43a6-8603-cb6eea7495ec tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:26.402986 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1b14441c-00b1-43a6-8603-cb6eea7495ec tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:40:26.412141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1b14441c-00b1-43a6-8603-cb6eea7495ec tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1567 microversion: 2.1 time: 0.332064 Feb 08 17:40:26.412985 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 515/1054] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:40:26 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:40:27.434505 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2749e2a3-61e0-4048-b33a-a0ef07e265a8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:40:27.435611 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2749e2a3-61e0-4048-b33a-a0ef07e265a8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:40:27.442946 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2749e2a3-61e0-4048-b33a-a0ef07e265a8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:27.443401 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2749e2a3-61e0-4048-b33a-a0ef07e265a8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:27.444318 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2749e2a3-61e0-4048-b33a-a0ef07e265a8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:27.444862 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2749e2a3-61e0-4048-b33a-a0ef07e265a8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:27.624872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2749e2a3-61e0-4048-b33a-a0ef07e265a8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:40:27.638317 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2749e2a3-61e0-4048-b33a-a0ef07e265a8 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1449 microversion: 2.1 time: 0.210104 Feb 08 17:40:27.639282 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 540/1055] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:40:27 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1449 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:40:28.602804 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-25b2b793-f23a-43c7-9098-4bee8083d430 req-94c2113d-d7fe-4999-a4b7-e51923dafe72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8692ef30-50d2-43bc-84ad-1d7308a694cf", "name": "network-vif-deleted", "tag": "cf060131-592b-49f3-bed4-02a89d544e1f"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:40:28.604706 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:40:28.604706 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:40:28.613248 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-25b2b793-f23a-43c7-9098-4bee8083d430 req-94c2113d-d7fe-4999-a4b7-e51923dafe72 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:28.613699 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-25b2b793-f23a-43c7-9098-4bee8083d430 req-94c2113d-d7fe-4999-a4b7-e51923dafe72 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:28.628091 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-25b2b793-f23a-43c7-9098-4bee8083d430 req-94c2113d-d7fe-4999-a4b7-e51923dafe72 service nova] Creating event network-vif-deleted:cf060131-592b-49f3-bed4-02a89d544e1f for instance 8692ef30-50d2-43bc-84ad-1d7308a694cf on hv-cinder-82204 Feb 08 17:40:28.634333 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-25b2b793-f23a-43c7-9098-4bee8083d430 req-94c2113d-d7fe-4999-a4b7-e51923dafe72 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120028 Feb 08 17:40:28.634984 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 516/1056] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:40:28.657549 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-82e67569-c611-42ef-bd95-75c0aad9c266 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:40:28.659195 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-82e67569-c611-42ef-bd95-75c0aad9c266 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:40:28.670854 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82e67569-c611-42ef-bd95-75c0aad9c266 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:28.671369 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82e67569-c611-42ef-bd95-75c0aad9c266 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:28.672645 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82e67569-c611-42ef-bd95-75c0aad9c266 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:28.673187 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-82e67569-c611-42ef-bd95-75c0aad9c266 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:29.000860 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-82e67569-c611-42ef-bd95-75c0aad9c266 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8379ee89f3474da488245ea1d34e704a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ccc8eef185498e9ceeef80e17e6481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:40:29.008601 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-82e67569-c611-42ef-bd95-75c0aad9c266 tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 200 len: 1219 microversion: 2.1 time: 0.355432 Feb 08 17:40:29.010255 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 541/1057] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:40:28 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 1219 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:40:30.027161 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b3cc8026-a3aa-470c-97b2-ee5f0b8ab34f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:40:30.027960 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-b3cc8026-a3aa-470c-97b2-ee5f0b8ab34f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] [instance: 8692ef30-50d2-43bc-84ad-1d7308a694cf] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:40:30.034496 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3cc8026-a3aa-470c-97b2-ee5f0b8ab34f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:30.034938 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3cc8026-a3aa-470c-97b2-ee5f0b8ab34f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:30.035709 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3cc8026-a3aa-470c-97b2-ee5f0b8ab34f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:40:30.036138 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-b3cc8026-a3aa-470c-97b2-ee5f0b8ab34f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:40:30.049825 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-b3cc8026-a3aa-470c-97b2-ee5f0b8ab34f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] HTTP exception thrown: Instance 8692ef30-50d2-43bc-84ad-1d7308a694cf could not be found. Feb 08 17:40:30.050420 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-b3cc8026-a3aa-470c-97b2-ee5f0b8ab34f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Returning 404 to user: Instance 8692ef30-50d2-43bc-84ad-1d7308a694cf could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:40:30.051241 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-b3cc8026-a3aa-470c-97b2-ee5f0b8ab34f tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf" status: 404 len: 111 microversion: 2.1 time: 0.028596 Feb 08 17:40:30.051801 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 517/1058] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:40:30 2022] GET /compute/v2.1/servers/8692ef30-50d2-43bc-84ad-1d7308a694cf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:40:30.207149 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-53a49a4d-e555-40ab-90f0-4478f7c17b1a tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] Calling method '.version_select at 0x7fd9fa164670>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:40:30.229322 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-53a49a4d-e555-40ab-90f0-4478f7c17b1a tempest-TestShelveInstance-1145200133 tempest-TestShelveInstance-1145200133-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-951021457" status: 202 len: 0 microversion: 2.1 time: 0.025820 Feb 08 17:40:30.229949 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 542/1059] 10.222.0.69 () {58 vars in 1250 bytes} [Tue Feb 8 17:40:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-951021457 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:40:48.399160 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5ddecdf6-ce18-4bf3-8bac-a27ea2b508af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Action: 'create', calling method: .version_select at 0x7fd9f9815d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-395420825"}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:40:48.413334 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-5ddecdf6-ce18-4bf3-8bac-a27ea2b508af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Getting quotas for project 12a62a1727984ff69d6de64fdfb1137e. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:40:48.417516 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-5ddecdf6-ce18-4bf3-8bac-a27ea2b508af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Getting quotas for user c3d8937bf8cf40019ff86f19cecf7b2a and project 12a62a1727984ff69d6de64fdfb1137e. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:40:48.429485 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5ddecdf6-ce18-4bf3-8bac-a27ea2b508af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [c046678a-8647-44f2-8bab-b4d00dcd74e6] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 08 17:40:49.436812 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO oslo.messaging._drivers.impl_rabbit [None req-5ddecdf6-ce18-4bf3-8bac-a27ea2b508af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [c046678a-8647-44f2-8bab-b4d00dcd74e6] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 44286. Feb 08 17:40:49.680794 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-5ddecdf6-ce18-4bf3-8bac-a27ea2b508af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Getting quotas for project 12a62a1727984ff69d6de64fdfb1137e. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:40:49.684474 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-5ddecdf6-ce18-4bf3-8bac-a27ea2b508af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Getting quotas for user c3d8937bf8cf40019ff86f19cecf7b2a and project 12a62a1727984ff69d6de64fdfb1137e. Resources: {'key_pairs'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:40:49.697433 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5ddecdf6-ce18-4bf3-8bac-a27ea2b508af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 1.525970 Feb 08 17:40:49.698041 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 518/1060] 10.222.0.69 () {60 vars in 1157 bytes} [Tue Feb 8 17:40:48 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:07.136233 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1751314825", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-395420825", "security_groups": [{"name": "tempest-secgroup-smoke-270351217"}], "block_device_mapping_v2": [{"uuid": "bbeb3b4b-1335-4ff6-adb1-e3e0b85a335e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "03f089e2-21e2-4958-941c-e799f90c427c"}]}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:41:07.259823 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.network.neutron [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] validate_networks() for [('03f089e2-21e2-4958-941c-e799f90c427c', None, None, None, None, None)] {{(pid=116480) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:41:07.799261 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Flavor limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:41:07.799678 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Image limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:41:07.800147 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Flavor pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:41:07.800552 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Image pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:41:07.800957 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:41:07.810102 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:07.810533 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:07.811383 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:07.811922 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:07.830699 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Getting quotas for project 12a62a1727984ff69d6de64fdfb1137e. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:41:07.836349 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Getting quotas for user c3d8937bf8cf40019ff86f19cecf7b2a and project 12a62a1727984ff69d6de64fdfb1137e. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:41:07.899113 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Going to run 1 instances... {{(pid=116480) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:41:07.902560 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bbeb3b4b-1335-4ff6-adb1-e3e0b85a335e',volume_size=None,volume_type=None)] {{(pid=116480) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:41:08.047963 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-3df424f1-c427-4ab4-9321-76f381be1ab8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.916537 Feb 08 17:41:08.048883 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 543/1061] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:41:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:41:08.059687 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-a4b49af4-642f-4620-b3a6-8c2deeff56f2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:08.060435 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-a4b49af4-642f-4620-b3a6-8c2deeff56f2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:08.127470 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-a4b49af4-642f-4620-b3a6-8c2deeff56f2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:08.138228 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-a4b49af4-642f-4620-b3a6-8c2deeff56f2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1094 microversion: 2.1 time: 0.082510 Feb 08 17:41:08.139168 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 519/1062] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:08 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:09.169090 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-128350af-a1f9-4509-a6c8-b1107d06edea tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:09.170316 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-128350af-a1f9-4509-a6c8-b1107d06edea tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:09.184438 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-128350af-a1f9-4509-a6c8-b1107d06edea tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:09.185444 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-128350af-a1f9-4509-a6c8-b1107d06edea tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:09.186923 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-128350af-a1f9-4509-a6c8-b1107d06edea tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:09.187756 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-128350af-a1f9-4509-a6c8-b1107d06edea tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:09.303056 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-128350af-a1f9-4509-a6c8-b1107d06edea tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:09.312441 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-128350af-a1f9-4509-a6c8-b1107d06edea tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1200 microversion: 2.1 time: 0.152051 Feb 08 17:41:09.313985 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 544/1063] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:09 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1200 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:10.333921 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-d6d0ca64-ac2c-4c6c-a2cb-9a7cdadad0ba tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:10.335248 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-d6d0ca64-ac2c-4c6c-a2cb-9a7cdadad0ba tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:10.344580 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d6d0ca64-ac2c-4c6c-a2cb-9a7cdadad0ba tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:10.345382 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d6d0ca64-ac2c-4c6c-a2cb-9a7cdadad0ba tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:10.348593 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d6d0ca64-ac2c-4c6c-a2cb-9a7cdadad0ba tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:10.349532 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-d6d0ca64-ac2c-4c6c-a2cb-9a7cdadad0ba tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:10.661712 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-d6d0ca64-ac2c-4c6c-a2cb-9a7cdadad0ba tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:10.670502 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-d6d0ca64-ac2c-4c6c-a2cb-9a7cdadad0ba tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1265 microversion: 2.1 time: 0.340876 Feb 08 17:41:10.671186 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 520/1064] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:10 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1265 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:11.223617 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-1465b9e2-1ac9-49ec-95e1-824f90def7d4 req-b978d1a9-73c4-4424-916a-5b4b24d77950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c59cc32-12d5-4231-8e96-f46b9f36ec47", "tag": "d0896923-3030-47a5-aa2d-2851f94e7668"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:41:11.225333 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:41:11.225333 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:41:11.251627 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-1465b9e2-1ac9-49ec-95e1-824f90def7d4 req-b978d1a9-73c4-4424-916a-5b4b24d77950 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:11.253689 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-1465b9e2-1ac9-49ec-95e1-824f90def7d4 req-b978d1a9-73c4-4424-916a-5b4b24d77950 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:11.280522 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-1465b9e2-1ac9-49ec-95e1-824f90def7d4 req-b978d1a9-73c4-4424-916a-5b4b24d77950 service nova] Creating event network-changed:d0896923-3030-47a5-aa2d-2851f94e7668 for instance 7c59cc32-12d5-4231-8e96-f46b9f36ec47 on hv-cinder-82204 Feb 08 17:41:11.287823 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-1465b9e2-1ac9-49ec-95e1-824f90def7d4 req-b978d1a9-73c4-4424-916a-5b4b24d77950 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068476 Feb 08 17:41:11.288887 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 545/1065] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:41:11.688788 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2cab6fdf-96eb-45e9-a31b-776764d94f9d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:11.690247 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2cab6fdf-96eb-45e9-a31b-776764d94f9d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:11.696851 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2cab6fdf-96eb-45e9-a31b-776764d94f9d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:11.697413 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2cab6fdf-96eb-45e9-a31b-776764d94f9d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:11.698297 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2cab6fdf-96eb-45e9-a31b-776764d94f9d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:11.698740 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2cab6fdf-96eb-45e9-a31b-776764d94f9d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:11.967245 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2cab6fdf-96eb-45e9-a31b-776764d94f9d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:11.976888 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2cab6fdf-96eb-45e9-a31b-776764d94f9d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1265 microversion: 2.1 time: 0.291793 Feb 08 17:41:11.984902 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 521/1066] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:11 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:13.000415 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-267a6afd-7c0a-4983-a1a2-8cdadf9b5c5c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:13.001027 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-267a6afd-7c0a-4983-a1a2-8cdadf9b5c5c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:13.009766 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-267a6afd-7c0a-4983-a1a2-8cdadf9b5c5c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:13.010243 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-267a6afd-7c0a-4983-a1a2-8cdadf9b5c5c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:13.011047 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-267a6afd-7c0a-4983-a1a2-8cdadf9b5c5c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:13.011490 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-267a6afd-7c0a-4983-a1a2-8cdadf9b5c5c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:13.156712 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-267a6afd-7c0a-4983-a1a2-8cdadf9b5c5c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:13.164820 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-267a6afd-7c0a-4983-a1a2-8cdadf9b5c5c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1265 microversion: 2.1 time: 0.169033 Feb 08 17:41:13.165425 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 546/1067] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:12 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:14.182535 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2346b1a9-94de-4e63-b622-ccca0f191907 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:14.183084 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2346b1a9-94de-4e63-b622-ccca0f191907 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:14.189472 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2346b1a9-94de-4e63-b622-ccca0f191907 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:14.189929 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2346b1a9-94de-4e63-b622-ccca0f191907 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:14.190722 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2346b1a9-94de-4e63-b622-ccca0f191907 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:14.191161 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2346b1a9-94de-4e63-b622-ccca0f191907 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:14.332538 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2346b1a9-94de-4e63-b622-ccca0f191907 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:14.339927 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2346b1a9-94de-4e63-b622-ccca0f191907 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1265 microversion: 2.1 time: 0.161599 Feb 08 17:41:14.340578 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 522/1068] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:14 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:15.357210 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-cd35c12a-3069-4e95-983e-91736ef5b4be tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:15.357805 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-cd35c12a-3069-4e95-983e-91736ef5b4be tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:15.364155 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cd35c12a-3069-4e95-983e-91736ef5b4be tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:15.364551 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cd35c12a-3069-4e95-983e-91736ef5b4be tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:15.365361 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cd35c12a-3069-4e95-983e-91736ef5b4be tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:15.365804 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-cd35c12a-3069-4e95-983e-91736ef5b4be tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:15.501872 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-cd35c12a-3069-4e95-983e-91736ef5b4be tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:15.520788 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-cd35c12a-3069-4e95-983e-91736ef5b4be tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1265 microversion: 2.1 time: 0.167327 Feb 08 17:41:15.521401 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 547/1069] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:15 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:16.538143 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-28864a29-ac4a-49d3-8194-cd82d18961d4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:16.538760 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-28864a29-ac4a-49d3-8194-cd82d18961d4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:16.544592 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-28864a29-ac4a-49d3-8194-cd82d18961d4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:16.545038 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-28864a29-ac4a-49d3-8194-cd82d18961d4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:16.545838 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-28864a29-ac4a-49d3-8194-cd82d18961d4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:16.546292 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-28864a29-ac4a-49d3-8194-cd82d18961d4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:16.688808 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-28864a29-ac4a-49d3-8194-cd82d18961d4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:16.696223 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-28864a29-ac4a-49d3-8194-cd82d18961d4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1265 microversion: 2.1 time: 0.161887 Feb 08 17:41:16.696779 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 523/1070] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:16 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:17.713455 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9c643a77-37d9-4918-8912-f93a60c9b548 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:17.714084 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9c643a77-37d9-4918-8912-f93a60c9b548 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:17.720290 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9c643a77-37d9-4918-8912-f93a60c9b548 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:17.721394 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9c643a77-37d9-4918-8912-f93a60c9b548 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:17.722163 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9c643a77-37d9-4918-8912-f93a60c9b548 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:17.722598 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9c643a77-37d9-4918-8912-f93a60c9b548 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:17.858616 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9c643a77-37d9-4918-8912-f93a60c9b548 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:17.866474 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9c643a77-37d9-4918-8912-f93a60c9b548 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1265 microversion: 2.1 time: 0.157001 Feb 08 17:41:17.867054 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 548/1071] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:17 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:18.883451 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-9dbdfde5-3532-4f95-8812-248d30d42894 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:18.884255 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-9dbdfde5-3532-4f95-8812-248d30d42894 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:18.890783 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9dbdfde5-3532-4f95-8812-248d30d42894 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:18.891229 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9dbdfde5-3532-4f95-8812-248d30d42894 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:18.892036 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9dbdfde5-3532-4f95-8812-248d30d42894 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:18.892469 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9dbdfde5-3532-4f95-8812-248d30d42894 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:19.056745 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-9dbdfde5-3532-4f95-8812-248d30d42894 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:19.064527 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-9dbdfde5-3532-4f95-8812-248d30d42894 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1265 microversion: 2.1 time: 0.184803 Feb 08 17:41:19.065286 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 524/1072] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:18 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:20.082671 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8a0cdc48-f087-4946-b2a1-864b48fefe76 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:20.083265 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8a0cdc48-f087-4946-b2a1-864b48fefe76 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:20.089718 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8a0cdc48-f087-4946-b2a1-864b48fefe76 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:20.090148 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8a0cdc48-f087-4946-b2a1-864b48fefe76 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:20.091015 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8a0cdc48-f087-4946-b2a1-864b48fefe76 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:20.091448 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8a0cdc48-f087-4946-b2a1-864b48fefe76 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:20.224719 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8a0cdc48-f087-4946-b2a1-864b48fefe76 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:20.232162 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8a0cdc48-f087-4946-b2a1-864b48fefe76 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1265 microversion: 2.1 time: 0.153099 Feb 08 17:41:20.232736 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 549/1073] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:20 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:20.911501 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-163b10eb-8fe0-43ae-ba72-fe061956e6fe req-8088b00c-0c37-4a92-b002-72baa197f8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c59cc32-12d5-4231-8e96-f46b9f36ec47", "name": "network-vif-plugged", "status": "completed", "tag": "d0896923-3030-47a5-aa2d-2851f94e7668"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:41:20.913072 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:41:20.913072 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:41:20.920387 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-163b10eb-8fe0-43ae-ba72-fe061956e6fe req-8088b00c-0c37-4a92-b002-72baa197f8e9 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:20.920831 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-163b10eb-8fe0-43ae-ba72-fe061956e6fe req-8088b00c-0c37-4a92-b002-72baa197f8e9 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:20.932777 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-163b10eb-8fe0-43ae-ba72-fe061956e6fe req-8088b00c-0c37-4a92-b002-72baa197f8e9 service nova] Creating event network-vif-plugged:d0896923-3030-47a5-aa2d-2851f94e7668 for instance 7c59cc32-12d5-4231-8e96-f46b9f36ec47 on hv-cinder-82204 Feb 08 17:41:20.937851 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-163b10eb-8fe0-43ae-ba72-fe061956e6fe req-8088b00c-0c37-4a92-b002-72baa197f8e9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030157 Feb 08 17:41:20.938707 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 525/1074] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:41:21.251476 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-967db9b9-be98-4870-97c0-75c4636b52a3 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:21.252836 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-967db9b9-be98-4870-97c0-75c4636b52a3 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:21.261902 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-967db9b9-be98-4870-97c0-75c4636b52a3 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:21.262596 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-967db9b9-be98-4870-97c0-75c4636b52a3 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:21.263400 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-967db9b9-be98-4870-97c0-75c4636b52a3 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:21.263837 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-967db9b9-be98-4870-97c0-75c4636b52a3 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:21.425541 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-967db9b9-be98-4870-97c0-75c4636b52a3 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:21.433099 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-967db9b9-be98-4870-97c0-75c4636b52a3 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1265 microversion: 2.1 time: 0.186572 Feb 08 17:41:21.433697 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 550/1075] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:21 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:41:22.452270 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-901e7429-a10b-4a85-8335-f0195a8ce853 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:22.453149 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-901e7429-a10b-4a85-8335-f0195a8ce853 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:22.459772 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-901e7429-a10b-4a85-8335-f0195a8ce853 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:22.460230 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-901e7429-a10b-4a85-8335-f0195a8ce853 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:22.461057 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-901e7429-a10b-4a85-8335-f0195a8ce853 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:22.461532 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-901e7429-a10b-4a85-8335-f0195a8ce853 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:22.617835 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-901e7429-a10b-4a85-8335-f0195a8ce853 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:22.625932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-901e7429-a10b-4a85-8335-f0195a8ce853 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1451 microversion: 2.1 time: 0.178487 Feb 08 17:41:22.626660 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 526/1076] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:22 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:22.641819 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-abbdb40b-a6b4-44b8-a660-1809fb234a60 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:41:22.642631 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-abbdb40b-a6b4-44b8-a660-1809fb234a60 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:41:22.648793 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-abbdb40b-a6b4-44b8-a660-1809fb234a60 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:22.649268 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-abbdb40b-a6b4-44b8-a660-1809fb234a60 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:22.650051 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-abbdb40b-a6b4-44b8-a660-1809fb234a60 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:22.650487 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-abbdb40b-a6b4-44b8-a660-1809fb234a60 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:22.794202 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-abbdb40b-a6b4-44b8-a660-1809fb234a60 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:41:22.814468 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-abbdb40b-a6b4-44b8-a660-1809fb234a60 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1451 microversion: 2.1 time: 0.176056 Feb 08 17:41:22.815079 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 551/1077] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:41:22 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:41:24.774977 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-cbcad055-b85b-4f70-b32b-312cce77d5cc req-ca16b829-07ab-4b96-890b-b979d0956698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c59cc32-12d5-4231-8e96-f46b9f36ec47", "tag": "d0896923-3030-47a5-aa2d-2851f94e7668"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:41:24.776919 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:41:24.776919 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:41:24.784905 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-cbcad055-b85b-4f70-b32b-312cce77d5cc req-ca16b829-07ab-4b96-890b-b979d0956698 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:41:24.785374 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-cbcad055-b85b-4f70-b32b-312cce77d5cc req-ca16b829-07ab-4b96-890b-b979d0956698 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:41:24.799043 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-cbcad055-b85b-4f70-b32b-312cce77d5cc req-ca16b829-07ab-4b96-890b-b979d0956698 service nova] Creating event network-changed:d0896923-3030-47a5-aa2d-2851f94e7668 for instance 7c59cc32-12d5-4231-8e96-f46b9f36ec47 on hv-cinder-82204 Feb 08 17:41:24.804683 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-cbcad055-b85b-4f70-b32b-312cce77d5cc req-ca16b829-07ab-4b96-890b-b979d0956698 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034341 Feb 08 17:41:24.805437 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 527/1078] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:41:44.779623 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:41:44.780369 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: Tue Feb 8 17:41:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:43:22.197315 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0543106e-d4e5-4079-a538-38473c79f1bf] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 08 17:43:22.200947 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9cd39808-9f7c-4d8f-a2d7-2ca4b2ed7ee9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:22.201466 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9cd39808-9f7c-4d8f-a2d7-2ca4b2ed7ee9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:22.207860 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cd39808-9f7c-4d8f-a2d7-2ca4b2ed7ee9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:22.208307 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cd39808-9f7c-4d8f-a2d7-2ca4b2ed7ee9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:22.209085 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cd39808-9f7c-4d8f-a2d7-2ca4b2ed7ee9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:22.209616 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9cd39808-9f7c-4d8f-a2d7-2ca4b2ed7ee9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:22.236279 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9cd39808-9f7c-4d8f-a2d7-2ca4b2ed7ee9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Going to try to terminate instance {{(pid=116480) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:43:22.315529 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9cd39808-9f7c-4d8f-a2d7-2ca4b2ed7ee9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 204 len: 0 microversion: 2.1 time: 0.119828 Feb 08 17:43:22.316134 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 552/1079] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:43:22 2022] DELETE /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:43:22.322775 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dac4872d-4d32-486c-95d3-75a32f0e5519] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 08 17:43:22.328024 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0e1bd80f-313c-4be4-bdd1-8303d1ec3499 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:22.328751 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0e1bd80f-313c-4be4-bdd1-8303d1ec3499 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:22.336855 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0e1bd80f-313c-4be4-bdd1-8303d1ec3499 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:22.337424 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0e1bd80f-313c-4be4-bdd1-8303d1ec3499 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:22.338322 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0e1bd80f-313c-4be4-bdd1-8303d1ec3499 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:22.338620 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0e1bd80f-313c-4be4-bdd1-8303d1ec3499 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:22.488567 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0e1bd80f-313c-4be4-bdd1-8303d1ec3499 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:22.496909 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0e1bd80f-313c-4be4-bdd1-8303d1ec3499 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1576 microversion: 2.1 time: 0.176281 Feb 08 17:43:22.497520 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 528/1080] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:22 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:23.516512 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-10165f52-f0df-4831-99c4-48b31d68abd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:23.517249 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-10165f52-f0df-4831-99c4-48b31d68abd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:23.527756 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-10165f52-f0df-4831-99c4-48b31d68abd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:23.528298 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-10165f52-f0df-4831-99c4-48b31d68abd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:23.529304 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-10165f52-f0df-4831-99c4-48b31d68abd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:23.529794 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-10165f52-f0df-4831-99c4-48b31d68abd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:23.536446 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] [0543106e-d4e5-4079-a538-38473c79f1bf] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 44506. Feb 08 17:43:23.693986 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-10165f52-f0df-4831-99c4-48b31d68abd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:23.707367 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-10165f52-f0df-4831-99c4-48b31d68abd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1576 microversion: 2.1 time: 0.195170 Feb 08 17:43:23.708310 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 553/1081] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:23 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:24.733104 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-75d3186d-4840-4981-a6c9-c2b16aa50d02 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:24.734972 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-75d3186d-4840-4981-a6c9-c2b16aa50d02 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:24.742542 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75d3186d-4840-4981-a6c9-c2b16aa50d02 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:24.743353 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75d3186d-4840-4981-a6c9-c2b16aa50d02 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:24.743896 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75d3186d-4840-4981-a6c9-c2b16aa50d02 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:24.744262 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-75d3186d-4840-4981-a6c9-c2b16aa50d02 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:24.760534 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO oslo.messaging._drivers.impl_rabbit [-] [dac4872d-4d32-486c-95d3-75a32f0e5519] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 44512. Feb 08 17:43:24.878742 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-75d3186d-4840-4981-a6c9-c2b16aa50d02 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:24.887273 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-75d3186d-4840-4981-a6c9-c2b16aa50d02 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 200 len: 1509 microversion: 2.1 time: 0.157932 Feb 08 17:43:24.887874 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 529/1082] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:24 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:24.996128 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-eab3833e-dce0-4423-91a1-de0fa5f75b38 req-c15ba8da-7cb7-42b4-8311-2403ac35a277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c59cc32-12d5-4231-8e96-f46b9f36ec47", "name": "network-vif-deleted", "tag": "d0896923-3030-47a5-aa2d-2851f94e7668"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:43:24.999486 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:43:24.999486 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:43:25.020608 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-eab3833e-dce0-4423-91a1-de0fa5f75b38 req-c15ba8da-7cb7-42b4-8311-2403ac35a277 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:25.021726 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-eab3833e-dce0-4423-91a1-de0fa5f75b38 req-c15ba8da-7cb7-42b4-8311-2403ac35a277 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:25.036302 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-eab3833e-dce0-4423-91a1-de0fa5f75b38 req-c15ba8da-7cb7-42b4-8311-2403ac35a277 service nova] Creating event network-vif-deleted:d0896923-3030-47a5-aa2d-2851f94e7668 for instance 7c59cc32-12d5-4231-8e96-f46b9f36ec47 on hv-cinder-82204 Feb 08 17:43:25.051199 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-eab3833e-dce0-4423-91a1-de0fa5f75b38 req-c15ba8da-7cb7-42b4-8311-2403ac35a277 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059882 Feb 08 17:43:25.051732 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 554/1083] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:43:25.906414 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-37ffd6d8-1986-4602-ab3f-74dd14f92df7 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:25.907723 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-37ffd6d8-1986-4602-ab3f-74dd14f92df7 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:25.915194 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37ffd6d8-1986-4602-ab3f-74dd14f92df7 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:25.915651 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37ffd6d8-1986-4602-ab3f-74dd14f92df7 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:25.916451 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37ffd6d8-1986-4602-ab3f-74dd14f92df7 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:25.916891 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-37ffd6d8-1986-4602-ab3f-74dd14f92df7 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:25.931648 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-37ffd6d8-1986-4602-ab3f-74dd14f92df7 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] HTTP exception thrown: Instance 7c59cc32-12d5-4231-8e96-f46b9f36ec47 could not be found. Feb 08 17:43:25.932244 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-37ffd6d8-1986-4602-ab3f-74dd14f92df7 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Returning 404 to user: Instance 7c59cc32-12d5-4231-8e96-f46b9f36ec47 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:43:25.933082 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-37ffd6d8-1986-4602-ab3f-74dd14f92df7 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 404 len: 111 microversion: 2.1 time: 0.030540 Feb 08 17:43:25.933674 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 530/1084] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:25 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:43:25.983417 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-349365660", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-395420825", "security_groups": [{"name": "tempest-secgroup-smoke-270351217"}], "block_device_mapping_v2": [{"uuid": "bbeb3b4b-1335-4ff6-adb1-e3e0b85a335e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "03f089e2-21e2-4958-941c-e799f90c427c"}]}} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:43:26.101320 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.network.neutron [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] validate_networks() for [('03f089e2-21e2-4958-941c-e799f90c427c', None, None, None, None, None)] {{(pid=116480) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:43:26.479888 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Flavor limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:43:26.480309 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Image limits 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:43:26.480779 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Flavor pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:43:26.481201 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Image pref 0:0:0 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:43:26.481609 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.virt.hardware [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116480) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:43:26.490943 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:26.491388 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:26.492199 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:26.492659 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:26.509703 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Getting quotas for project 12a62a1727984ff69d6de64fdfb1137e. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:43:26.514106 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.quota [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Getting quotas for user c3d8937bf8cf40019ff86f19cecf7b2a and project 12a62a1727984ff69d6de64fdfb1137e. Resources: {'instances', 'ram', 'cores'} {{(pid=116480) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:43:26.570119 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Going to run 1 instances... {{(pid=116480) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:43:26.572422 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bbeb3b4b-1335-4ff6-adb1-e3e0b85a335e',volume_size=None,volume_type=None)] {{(pid=116480) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:43:26.698003 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-a9b05646-14d9-4953-a2a5-e4295ffed17f tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.719483 Feb 08 17:43:26.698646 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 555/1085] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:43:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 08 17:43:26.709422 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-ddb5a69d-88ce-4783-86ec-14bdbd8fe856 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:26.710029 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-ddb5a69d-88ce-4783-86ec-14bdbd8fe856 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:26.765564 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-ddb5a69d-88ce-4783-86ec-14bdbd8fe856 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:26.774311 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-ddb5a69d-88ce-4783-86ec-14bdbd8fe856 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1093 microversion: 2.1 time: 0.068513 Feb 08 17:43:26.774844 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 531/1086] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:26 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:27.791249 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-818d91c3-522d-4233-b879-58d7fe8f7b64 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:27.791950 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-818d91c3-522d-4233-b879-58d7fe8f7b64 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:27.800202 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-818d91c3-522d-4233-b879-58d7fe8f7b64 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:27.800950 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-818d91c3-522d-4233-b879-58d7fe8f7b64 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:27.801792 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-818d91c3-522d-4233-b879-58d7fe8f7b64 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:27.802234 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-818d91c3-522d-4233-b879-58d7fe8f7b64 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:27.872752 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-818d91c3-522d-4233-b879-58d7fe8f7b64 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:27.885629 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-818d91c3-522d-4233-b879-58d7fe8f7b64 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1209 microversion: 2.1 time: 0.097853 Feb 08 17:43:27.886701 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 556/1087] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:27 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:28.903468 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-7dfc68f9-84ce-4269-8d67-34beb992075b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:28.904980 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-7dfc68f9-84ce-4269-8d67-34beb992075b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:28.914114 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7dfc68f9-84ce-4269-8d67-34beb992075b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:28.914588 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7dfc68f9-84ce-4269-8d67-34beb992075b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:28.915365 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7dfc68f9-84ce-4269-8d67-34beb992075b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:28.915881 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-7dfc68f9-84ce-4269-8d67-34beb992075b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:29.148961 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-7dfc68f9-84ce-4269-8d67-34beb992075b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:29.161246 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-7dfc68f9-84ce-4269-8d67-34beb992075b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1264 microversion: 2.1 time: 0.261721 Feb 08 17:43:29.161929 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 532/1088] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:28 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1264 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:43:29.226078 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-ac347066-5ada-42f1-af4f-36b42b0c53fc req-4593e36b-217f-4103-8fd5-127241ec5696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7d62d9-29ba-4b7d-8c8e-f258e5758129", "tag": "625fdd0a-3cda-4343-be95-b1644117908b"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:43:29.228552 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:43:29.228552 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:43:29.237911 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-ac347066-5ada-42f1-af4f-36b42b0c53fc req-4593e36b-217f-4103-8fd5-127241ec5696 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:29.238358 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-ac347066-5ada-42f1-af4f-36b42b0c53fc req-4593e36b-217f-4103-8fd5-127241ec5696 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:29.250490 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-ac347066-5ada-42f1-af4f-36b42b0c53fc req-4593e36b-217f-4103-8fd5-127241ec5696 service nova] Creating event network-changed:625fdd0a-3cda-4343-be95-b1644117908b for instance 6a7d62d9-29ba-4b7d-8c8e-f258e5758129 on hv-cinder-82204 Feb 08 17:43:29.255891 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-ac347066-5ada-42f1-af4f-36b42b0c53fc req-4593e36b-217f-4103-8fd5-127241ec5696 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034286 Feb 08 17:43:29.256808 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 557/1089] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:43:29.899936 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:43:29.900141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: Tue Feb 8 17:43:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:43:30.181689 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-29487316-4604-42a8-b79e-3765dc640fd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:30.182605 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-29487316-4604-42a8-b79e-3765dc640fd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:30.191429 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-29487316-4604-42a8-b79e-3765dc640fd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:30.192212 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-29487316-4604-42a8-b79e-3765dc640fd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:30.193769 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-29487316-4604-42a8-b79e-3765dc640fd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:30.194570 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-29487316-4604-42a8-b79e-3765dc640fd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:30.425788 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-29487316-4604-42a8-b79e-3765dc640fd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:30.433146 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-29487316-4604-42a8-b79e-3765dc640fd4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1264 microversion: 2.1 time: 0.256855 Feb 08 17:43:30.433678 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 533/1090] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:30 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:31.451122 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-1fa584be-247f-49d3-a647-21f0b1bb1bf0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:31.451828 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-1fa584be-247f-49d3-a647-21f0b1bb1bf0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:31.458175 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1fa584be-247f-49d3-a647-21f0b1bb1bf0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:31.458627 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1fa584be-247f-49d3-a647-21f0b1bb1bf0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:31.459417 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1fa584be-247f-49d3-a647-21f0b1bb1bf0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:31.459858 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-1fa584be-247f-49d3-a647-21f0b1bb1bf0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:31.603154 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-1fa584be-247f-49d3-a647-21f0b1bb1bf0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:31.610943 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-1fa584be-247f-49d3-a647-21f0b1bb1bf0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1264 microversion: 2.1 time: 0.164634 Feb 08 17:43:31.611624 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 558/1091] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:31 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:32.630778 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-c7ab5ff8-c5f8-4d48-9196-e6f34bc92ebd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:32.631433 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-c7ab5ff8-c5f8-4d48-9196-e6f34bc92ebd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:32.637713 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c7ab5ff8-c5f8-4d48-9196-e6f34bc92ebd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:32.638154 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c7ab5ff8-c5f8-4d48-9196-e6f34bc92ebd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:32.638932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c7ab5ff8-c5f8-4d48-9196-e6f34bc92ebd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:32.639366 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-c7ab5ff8-c5f8-4d48-9196-e6f34bc92ebd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:32.781666 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-c7ab5ff8-c5f8-4d48-9196-e6f34bc92ebd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:32.789053 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-c7ab5ff8-c5f8-4d48-9196-e6f34bc92ebd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1264 microversion: 2.1 time: 0.162733 Feb 08 17:43:32.789664 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 534/1092] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:32 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:33.806363 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-565efce4-6857-4e46-a218-c2fc2ac9c3f8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:33.807162 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-565efce4-6857-4e46-a218-c2fc2ac9c3f8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:33.813493 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-565efce4-6857-4e46-a218-c2fc2ac9c3f8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:33.813947 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-565efce4-6857-4e46-a218-c2fc2ac9c3f8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:33.814743 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-565efce4-6857-4e46-a218-c2fc2ac9c3f8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:33.815179 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-565efce4-6857-4e46-a218-c2fc2ac9c3f8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:33.955894 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-565efce4-6857-4e46-a218-c2fc2ac9c3f8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:33.963375 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-565efce4-6857-4e46-a218-c2fc2ac9c3f8 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1264 microversion: 2.1 time: 0.161084 Feb 08 17:43:33.964587 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 559/1093] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:33 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:34.980441 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-56268d2e-c28c-4857-adcd-7411bb6c1ce9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:34.980986 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-56268d2e-c28c-4857-adcd-7411bb6c1ce9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:34.988300 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-56268d2e-c28c-4857-adcd-7411bb6c1ce9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:34.988739 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-56268d2e-c28c-4857-adcd-7411bb6c1ce9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:34.989572 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-56268d2e-c28c-4857-adcd-7411bb6c1ce9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:34.989997 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-56268d2e-c28c-4857-adcd-7411bb6c1ce9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:35.130657 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-56268d2e-c28c-4857-adcd-7411bb6c1ce9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:35.138645 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-56268d2e-c28c-4857-adcd-7411bb6c1ce9 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1264 microversion: 2.1 time: 0.162624 Feb 08 17:43:35.139209 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 535/1094] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:34 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:35.948840 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:43:35.949422 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: Tue Feb 8 17:43:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:43:36.155413 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2b579c36-6598-46f4-891d-be0b0100bc0e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:36.155911 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2b579c36-6598-46f4-891d-be0b0100bc0e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:36.162588 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b579c36-6598-46f4-891d-be0b0100bc0e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:36.163036 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b579c36-6598-46f4-891d-be0b0100bc0e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:36.163822 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b579c36-6598-46f4-891d-be0b0100bc0e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:36.164254 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2b579c36-6598-46f4-891d-be0b0100bc0e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:36.304211 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2b579c36-6598-46f4-891d-be0b0100bc0e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:36.311745 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2b579c36-6598-46f4-891d-be0b0100bc0e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1264 microversion: 2.1 time: 0.160063 Feb 08 17:43:36.312311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 560/1095] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:36 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:37.329144 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-fe8346d1-9684-41b3-8020-532cfc7a39af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:37.329799 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-fe8346d1-9684-41b3-8020-532cfc7a39af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:37.336856 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe8346d1-9684-41b3-8020-532cfc7a39af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:37.337345 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe8346d1-9684-41b3-8020-532cfc7a39af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:37.338125 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe8346d1-9684-41b3-8020-532cfc7a39af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:37.338550 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe8346d1-9684-41b3-8020-532cfc7a39af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:37.483559 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-fe8346d1-9684-41b3-8020-532cfc7a39af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:37.491359 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-fe8346d1-9684-41b3-8020-532cfc7a39af tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1264 microversion: 2.1 time: 0.165948 Feb 08 17:43:37.491995 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 536/1096] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:37 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:38.508360 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9aab890e-6324-42ac-bff8-2433daeec056 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:38.508953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9aab890e-6324-42ac-bff8-2433daeec056 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:38.515196 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9aab890e-6324-42ac-bff8-2433daeec056 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:38.515642 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9aab890e-6324-42ac-bff8-2433daeec056 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:38.516410 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9aab890e-6324-42ac-bff8-2433daeec056 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:38.516840 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9aab890e-6324-42ac-bff8-2433daeec056 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:38.650670 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-9aab890e-6324-42ac-bff8-2433daeec056 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:38.658481 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9aab890e-6324-42ac-bff8-2433daeec056 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1264 microversion: 2.1 time: 0.153596 Feb 08 17:43:38.659141 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 561/1097] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:38 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:39.598654 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-7a9fb24b-a0de-4dff-ac76-a8cf42fd5e70 req-c54fc910-4ab7-4280-873d-84f4320c4fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7d62d9-29ba-4b7d-8c8e-f258e5758129", "name": "network-vif-plugged", "status": "completed", "tag": "625fdd0a-3cda-4343-be95-b1644117908b"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:43:39.600208 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:43:39.600208 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:43:39.607684 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-7a9fb24b-a0de-4dff-ac76-a8cf42fd5e70 req-c54fc910-4ab7-4280-873d-84f4320c4fd4 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:39.608066 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-7a9fb24b-a0de-4dff-ac76-a8cf42fd5e70 req-c54fc910-4ab7-4280-873d-84f4320c4fd4 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:39.622103 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-7a9fb24b-a0de-4dff-ac76-a8cf42fd5e70 req-c54fc910-4ab7-4280-873d-84f4320c4fd4 service nova] Creating event network-vif-plugged:625fdd0a-3cda-4343-be95-b1644117908b for instance 6a7d62d9-29ba-4b7d-8c8e-f258e5758129 on hv-cinder-82204 Feb 08 17:43:39.629348 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-7a9fb24b-a0de-4dff-ac76-a8cf42fd5e70 req-c54fc910-4ab7-4280-873d-84f4320c4fd4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034516 Feb 08 17:43:39.630241 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 537/1098] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:43:39.675521 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-71d23fb0-0a12-49c7-aec7-159265b3735e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:39.676282 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-71d23fb0-0a12-49c7-aec7-159265b3735e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:39.682861 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71d23fb0-0a12-49c7-aec7-159265b3735e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:39.683309 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71d23fb0-0a12-49c7-aec7-159265b3735e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:39.684105 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71d23fb0-0a12-49c7-aec7-159265b3735e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:39.684541 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-71d23fb0-0a12-49c7-aec7-159265b3735e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:39.832342 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-71d23fb0-0a12-49c7-aec7-159265b3735e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:39.839871 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-71d23fb0-0a12-49c7-aec7-159265b3735e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1264 microversion: 2.1 time: 0.168553 Feb 08 17:43:39.840443 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 562/1099] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:39 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:40.861668 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6d5ea286-145f-4d9c-b3a7-765c3a29ac1b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:40.863541 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6d5ea286-145f-4d9c-b3a7-765c3a29ac1b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:40.873394 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6d5ea286-145f-4d9c-b3a7-765c3a29ac1b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:40.873903 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6d5ea286-145f-4d9c-b3a7-765c3a29ac1b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:40.874714 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6d5ea286-145f-4d9c-b3a7-765c3a29ac1b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:40.875149 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6d5ea286-145f-4d9c-b3a7-765c3a29ac1b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:41.061139 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-6d5ea286-145f-4d9c-b3a7-765c3a29ac1b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:41.070177 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6d5ea286-145f-4d9c-b3a7-765c3a29ac1b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1264 microversion: 2.1 time: 0.216139 Feb 08 17:43:41.070757 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 538/1100] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:40 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:42.087853 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-7fca2c7d-3e7a-4f08-b7da-4a422ce8cf61 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:42.088468 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-7fca2c7d-3e7a-4f08-b7da-4a422ce8cf61 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:42.094778 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7fca2c7d-3e7a-4f08-b7da-4a422ce8cf61 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:42.095216 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7fca2c7d-3e7a-4f08-b7da-4a422ce8cf61 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:42.096009 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7fca2c7d-3e7a-4f08-b7da-4a422ce8cf61 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:42.096590 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-7fca2c7d-3e7a-4f08-b7da-4a422ce8cf61 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:42.239681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-7fca2c7d-3e7a-4f08-b7da-4a422ce8cf61 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:42.247243 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-7fca2c7d-3e7a-4f08-b7da-4a422ce8cf61 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1450 microversion: 2.1 time: 0.163049 Feb 08 17:43:42.248174 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 563/1101] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:42 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:43:42.264640 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-720a942c-e5b0-4010-8be1-52745ce0ce1d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:43:42.265267 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-720a942c-e5b0-4010-8be1-52745ce0ce1d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:43:42.271996 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-720a942c-e5b0-4010-8be1-52745ce0ce1d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:42.272442 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-720a942c-e5b0-4010-8be1-52745ce0ce1d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:42.273331 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-720a942c-e5b0-4010-8be1-52745ce0ce1d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:42.273707 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-720a942c-e5b0-4010-8be1-52745ce0ce1d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:42.418510 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-720a942c-e5b0-4010-8be1-52745ce0ce1d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:43:42.427446 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-720a942c-e5b0-4010-8be1-52745ce0ce1d tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1450 microversion: 2.1 time: 0.166379 Feb 08 17:43:42.428022 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 539/1102] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:43:42 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1450 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 17:43:44.393843 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-b91ba326-8035-4b6a-8c34-6b36b969602b req-4f1b3420-dc91-4a6f-adee-f75b65c2e517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7d62d9-29ba-4b7d-8c8e-f258e5758129", "tag": "625fdd0a-3cda-4343-be95-b1644117908b"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:43:44.395972 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:43:44.395972 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:43:44.403563 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-b91ba326-8035-4b6a-8c34-6b36b969602b req-4f1b3420-dc91-4a6f-adee-f75b65c2e517 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:43:44.404042 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-b91ba326-8035-4b6a-8c34-6b36b969602b req-4f1b3420-dc91-4a6f-adee-f75b65c2e517 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:43:44.416266 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-b91ba326-8035-4b6a-8c34-6b36b969602b req-4f1b3420-dc91-4a6f-adee-f75b65c2e517 service nova] Creating event network-changed:625fdd0a-3cda-4343-be95-b1644117908b for instance 6a7d62d9-29ba-4b7d-8c8e-f258e5758129 on hv-cinder-82204 Feb 08 17:43:44.429466 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-b91ba326-8035-4b6a-8c34-6b36b969602b req-4f1b3420-dc91-4a6f-adee-f75b65c2e517 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039759 Feb 08 17:43:44.430833 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 564/1103] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:45:04.791254 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:45:04.791893 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: Tue Feb 8 17:45:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:45:35.513777 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1305794523", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-395420825", "security_groups": [{"name": "tempest-secgroup-smoke-270351217"}], "block_device_mapping_v2": [{"uuid": "82caaecb-40c6-4631-bfb1-3df926e79c6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "03f089e2-21e2-4958-941c-e799f90c427c"}]}} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:45:35.782636 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.network.neutron [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] validate_networks() for [('03f089e2-21e2-4958-941c-e799f90c427c', None, None, None, None, None)] {{(pid=116479) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 17:45:36.224884 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Flavor limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 17:45:36.225342 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Image limits 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 17:45:36.225822 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Flavor pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 17:45:36.226232 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Image pref 0:0:0 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 17:45:36.226646 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.virt.hardware [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 17:45:36.235450 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:36.235900 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:36.236728 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:36.237182 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:36.253290 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Getting quotas for project 12a62a1727984ff69d6de64fdfb1137e. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 17:45:36.257387 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.quota [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Getting quotas for user c3d8937bf8cf40019ff86f19cecf7b2a and project 12a62a1727984ff69d6de64fdfb1137e. Resources: {'instances', 'ram', 'cores'} {{(pid=116479) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 17:45:36.313916 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Going to run 1 instances... {{(pid=116479) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 17:45:36.316064 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82caaecb-40c6-4631-bfb1-3df926e79c6f',volume_size=None,volume_type=None)] {{(pid=116479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 17:45:36.447455 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5128d68f-a265-45e1-8410-b2a25974aba2 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.938261 Feb 08 17:45:36.448103 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 540/1104] 10.222.0.69 () {60 vars in 1146 bytes} [Tue Feb 8 17:45:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 17:45:36.456614 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0543106e-d4e5-4079-a538-38473c79f1bf] AMQP server on 10.222.0.69:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 08 17:45:36.460910 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e8fee872-842e-4839-bcca-4a6813dabc52 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:36.461715 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e8fee872-842e-4839-bcca-4a6813dabc52 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:36.581017 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e8fee872-842e-4839-bcca-4a6813dabc52 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:36.587607 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e8fee872-842e-4839-bcca-4a6813dabc52 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1094 microversion: 2.1 time: 0.133169 Feb 08 17:45:36.588407 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 565/1105] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:36 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1094 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:37.605009 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-1a8b5296-4a04-4268-8c53-646005a33d2a tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:37.605969 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-1a8b5296-4a04-4268-8c53-646005a33d2a tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:37.613051 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a8b5296-4a04-4268-8c53-646005a33d2a tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:37.613599 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a8b5296-4a04-4268-8c53-646005a33d2a tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:37.614579 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a8b5296-4a04-4268-8c53-646005a33d2a tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:37.615122 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-1a8b5296-4a04-4268-8c53-646005a33d2a tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:37.707711 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-1a8b5296-4a04-4268-8c53-646005a33d2a tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:37.716129 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-1a8b5296-4a04-4268-8c53-646005a33d2a tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1210 microversion: 2.1 time: 0.115470 Feb 08 17:45:37.717150 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 541/1106] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:37 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:38.733403 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e993957c-a086-4688-b974-60fcc3d294cf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:38.734109 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e993957c-a086-4688-b974-60fcc3d294cf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:38.744065 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e993957c-a086-4688-b974-60fcc3d294cf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:38.744632 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e993957c-a086-4688-b974-60fcc3d294cf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:38.745679 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e993957c-a086-4688-b974-60fcc3d294cf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:38.746186 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e993957c-a086-4688-b974-60fcc3d294cf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:38.767567 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] [0543106e-d4e5-4079-a538-38473c79f1bf] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 44698. Feb 08 17:45:38.908517 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e993957c-a086-4688-b974-60fcc3d294cf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:38.917049 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e993957c-a086-4688-b974-60fcc3d294cf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1265 microversion: 2.1 time: 0.187172 Feb 08 17:45:38.917667 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 566/1107] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:38 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:39.044275 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-9079ba16-9541-4c7d-9a92-c34d887fa4cc req-c8f237c9-2c13-4153-999d-8d54d9b7610e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d821bfc-fe28-4943-bbf6-2292f4b0df79", "tag": "436369f6-dff7-4ec3-ad22-70faf21d52fc"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:45:39.046426 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:45:39.046426 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:45:39.054756 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-9079ba16-9541-4c7d-9a92-c34d887fa4cc req-c8f237c9-2c13-4153-999d-8d54d9b7610e service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:39.055287 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-9079ba16-9541-4c7d-9a92-c34d887fa4cc req-c8f237c9-2c13-4153-999d-8d54d9b7610e service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:39.072082 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-9079ba16-9541-4c7d-9a92-c34d887fa4cc req-c8f237c9-2c13-4153-999d-8d54d9b7610e service nova] Creating event network-changed:436369f6-dff7-4ec3-ad22-70faf21d52fc for instance 4d821bfc-fe28-4943-bbf6-2292f4b0df79 on hv-cinder-82204 Feb 08 17:45:39.079002 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-9079ba16-9541-4c7d-9a92-c34d887fa4cc req-c8f237c9-2c13-4153-999d-8d54d9b7610e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121065 Feb 08 17:45:39.080310 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 542/1108] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:45:39.934865 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-2bcd72e5-2047-482e-b166-45c0ce586d74 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:39.935439 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-2bcd72e5-2047-482e-b166-45c0ce586d74 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:39.941838 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2bcd72e5-2047-482e-b166-45c0ce586d74 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:39.942298 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2bcd72e5-2047-482e-b166-45c0ce586d74 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:39.943138 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2bcd72e5-2047-482e-b166-45c0ce586d74 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:39.943578 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-2bcd72e5-2047-482e-b166-45c0ce586d74 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:40.092647 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-2bcd72e5-2047-482e-b166-45c0ce586d74 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:40.101851 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-2bcd72e5-2047-482e-b166-45c0ce586d74 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1265 microversion: 2.1 time: 0.170913 Feb 08 17:45:40.102429 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 567/1109] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:39 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:41.119984 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-940c68cd-466b-4347-8fee-83d6652e7caf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:41.120581 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-940c68cd-466b-4347-8fee-83d6652e7caf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:41.126738 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-940c68cd-466b-4347-8fee-83d6652e7caf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:41.127175 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-940c68cd-466b-4347-8fee-83d6652e7caf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:41.127957 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-940c68cd-466b-4347-8fee-83d6652e7caf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:41.128380 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-940c68cd-466b-4347-8fee-83d6652e7caf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:41.268930 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-940c68cd-466b-4347-8fee-83d6652e7caf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:41.276640 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-940c68cd-466b-4347-8fee-83d6652e7caf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1265 microversion: 2.1 time: 0.161849 Feb 08 17:45:41.277217 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 543/1110] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:41 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:42.294371 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d9c3bb65-40cd-4b0f-9a8e-8e6c095226a0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:42.295014 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d9c3bb65-40cd-4b0f-9a8e-8e6c095226a0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:42.301409 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d9c3bb65-40cd-4b0f-9a8e-8e6c095226a0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:42.301966 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d9c3bb65-40cd-4b0f-9a8e-8e6c095226a0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:42.302764 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d9c3bb65-40cd-4b0f-9a8e-8e6c095226a0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:42.303210 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d9c3bb65-40cd-4b0f-9a8e-8e6c095226a0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:42.444916 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d9c3bb65-40cd-4b0f-9a8e-8e6c095226a0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:42.452940 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d9c3bb65-40cd-4b0f-9a8e-8e6c095226a0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1265 microversion: 2.1 time: 0.162608 Feb 08 17:45:42.453572 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 568/1111] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:42 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:43.470382 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-fe3537b4-6605-412d-8847-b550fd4c1e03 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:43.470985 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-fe3537b4-6605-412d-8847-b550fd4c1e03 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:43.478687 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe3537b4-6605-412d-8847-b550fd4c1e03 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:43.479237 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe3537b4-6605-412d-8847-b550fd4c1e03 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:43.480295 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe3537b4-6605-412d-8847-b550fd4c1e03 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:43.480778 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-fe3537b4-6605-412d-8847-b550fd4c1e03 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:43.625261 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-fe3537b4-6605-412d-8847-b550fd4c1e03 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:43.632936 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-fe3537b4-6605-412d-8847-b550fd4c1e03 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1265 microversion: 2.1 time: 0.166287 Feb 08 17:45:43.633932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 544/1112] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:43 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:44.650551 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-e16283f2-350a-48e0-be02-136331c8a8b0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:44.651147 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-e16283f2-350a-48e0-be02-136331c8a8b0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:44.657534 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e16283f2-350a-48e0-be02-136331c8a8b0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:44.657984 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e16283f2-350a-48e0-be02-136331c8a8b0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:44.658760 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e16283f2-350a-48e0-be02-136331c8a8b0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:44.659191 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-e16283f2-350a-48e0-be02-136331c8a8b0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:44.812330 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-e16283f2-350a-48e0-be02-136331c8a8b0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:44.822337 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-e16283f2-350a-48e0-be02-136331c8a8b0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1265 microversion: 2.1 time: 0.175452 Feb 08 17:45:44.823253 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 569/1113] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:44 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:45.841579 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2e08b289-ec4e-4152-93ba-e785e713e780 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:45.842323 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2e08b289-ec4e-4152-93ba-e785e713e780 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:45.848692 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2e08b289-ec4e-4152-93ba-e785e713e780 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:45.849143 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2e08b289-ec4e-4152-93ba-e785e713e780 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:45.850474 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2e08b289-ec4e-4152-93ba-e785e713e780 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:45.850947 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2e08b289-ec4e-4152-93ba-e785e713e780 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:45.996960 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-2e08b289-ec4e-4152-93ba-e785e713e780 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:46.004364 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2e08b289-ec4e-4152-93ba-e785e713e780 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1265 microversion: 2.1 time: 0.166804 Feb 08 17:45:46.004939 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 545/1114] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:45 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:47.023653 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-d3ecd213-37b4-4ba8-aacf-df177d06c1c0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:47.024550 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-d3ecd213-37b4-4ba8-aacf-df177d06c1c0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:47.031907 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d3ecd213-37b4-4ba8-aacf-df177d06c1c0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:47.032361 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d3ecd213-37b4-4ba8-aacf-df177d06c1c0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:47.033151 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d3ecd213-37b4-4ba8-aacf-df177d06c1c0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:47.033839 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-d3ecd213-37b4-4ba8-aacf-df177d06c1c0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:47.189508 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-d3ecd213-37b4-4ba8-aacf-df177d06c1c0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:47.200764 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-d3ecd213-37b4-4ba8-aacf-df177d06c1c0 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1265 microversion: 2.1 time: 0.182794 Feb 08 17:45:47.201400 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 570/1115] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:47 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:48.218167 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-b6a46cdb-f7d1-4d3b-9f30-29a7bd985cd1 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:48.218824 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-b6a46cdb-f7d1-4d3b-9f30-29a7bd985cd1 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:48.233066 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b6a46cdb-f7d1-4d3b-9f30-29a7bd985cd1 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:48.238013 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b6a46cdb-f7d1-4d3b-9f30-29a7bd985cd1 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:48.239153 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b6a46cdb-f7d1-4d3b-9f30-29a7bd985cd1 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:48.239605 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-b6a46cdb-f7d1-4d3b-9f30-29a7bd985cd1 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:48.286411 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [req-5fdf0ec5-b823-4089-be67-d40ea51d4ab2 req-eead8256-8fd1-48ad-80ad-ac8a0251e087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d821bfc-fe28-4943-bbf6-2292f4b0df79", "name": "network-vif-plugged", "status": "completed", "tag": "436369f6-dff7-4ec3-ad22-70faf21d52fc"}]} {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:45:48.288503 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:45:48.288503 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: warnings.warn(msg) Feb 08 17:45:48.308014 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-5fdf0ec5-b823-4089-be67-d40ea51d4ab2 req-eead8256-8fd1-48ad-80ad-ac8a0251e087 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:48.308429 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [req-5fdf0ec5-b823-4089-be67-d40ea51d4ab2 req-eead8256-8fd1-48ad-80ad-ac8a0251e087 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:48.334653 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.compute.server_external_events [req-5fdf0ec5-b823-4089-be67-d40ea51d4ab2 req-eead8256-8fd1-48ad-80ad-ac8a0251e087 service nova] Creating event network-vif-plugged:436369f6-dff7-4ec3-ad22-70faf21d52fc for instance 4d821bfc-fe28-4943-bbf6-2292f4b0df79 on hv-cinder-82204 Feb 08 17:45:48.341193 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [req-5fdf0ec5-b823-4089-be67-d40ea51d4ab2 req-eead8256-8fd1-48ad-80ad-ac8a0251e087 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130197 Feb 08 17:45:48.342749 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 546/1116] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:45:48.422211 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-b6a46cdb-f7d1-4d3b-9f30-29a7bd985cd1 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:48.433799 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-b6a46cdb-f7d1-4d3b-9f30-29a7bd985cd1 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1265 microversion: 2.1 time: 0.219479 Feb 08 17:45:48.434775 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 571/1117] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:48 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:49.506497 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-9e05ff60-0d2c-4dce-92bc-6d17584d3034 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:49.507600 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-9e05ff60-0d2c-4dce-92bc-6d17584d3034 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:49.515250 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9e05ff60-0d2c-4dce-92bc-6d17584d3034 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:49.515693 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9e05ff60-0d2c-4dce-92bc-6d17584d3034 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:49.516501 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9e05ff60-0d2c-4dce-92bc-6d17584d3034 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:49.516933 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-9e05ff60-0d2c-4dce-92bc-6d17584d3034 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:49.681375 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-9e05ff60-0d2c-4dce-92bc-6d17584d3034 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:49.690913 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-9e05ff60-0d2c-4dce-92bc-6d17584d3034 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1265 microversion: 2.1 time: 0.237790 Feb 08 17:45:49.691574 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 547/1118] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:49 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:50.708498 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-f8000a58-5b5f-4e8f-a500-b59eaa59d963 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:50.709227 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-f8000a58-5b5f-4e8f-a500-b59eaa59d963 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:50.716603 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f8000a58-5b5f-4e8f-a500-b59eaa59d963 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:50.716961 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f8000a58-5b5f-4e8f-a500-b59eaa59d963 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:50.717804 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f8000a58-5b5f-4e8f-a500-b59eaa59d963 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:50.718242 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-f8000a58-5b5f-4e8f-a500-b59eaa59d963 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:50.889745 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-f8000a58-5b5f-4e8f-a500-b59eaa59d963 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:50.899944 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-f8000a58-5b5f-4e8f-a500-b59eaa59d963 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1451 microversion: 2.1 time: 0.195061 Feb 08 17:45:50.900740 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 572/1119] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:50 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1451 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:50.931111 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-24a7d491-8f87-4a5a-999b-a5bb5fbfd968 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:45:50.932552 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-24a7d491-8f87-4a5a-999b-a5bb5fbfd968 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:45:50.944249 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24a7d491-8f87-4a5a-999b-a5bb5fbfd968 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:50.945070 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24a7d491-8f87-4a5a-999b-a5bb5fbfd968 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:50.946440 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24a7d491-8f87-4a5a-999b-a5bb5fbfd968 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:50.947221 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-24a7d491-8f87-4a5a-999b-a5bb5fbfd968 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:51.118029 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-24a7d491-8f87-4a5a-999b-a5bb5fbfd968 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:45:51.126201 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-24a7d491-8f87-4a5a-999b-a5bb5fbfd968 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1451 microversion: 2.1 time: 0.203337 Feb 08 17:45:51.126848 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 548/1120] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:45:50 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1451 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:45:53.178375 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-743fde4e-7ccd-4fe9-bddb-f2176d4b9707 req-2345e849-d8d0-496c-a871-e0e45ea2e91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d821bfc-fe28-4943-bbf6-2292f4b0df79", "tag": "436369f6-dff7-4ec3-ad22-70faf21d52fc"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:45:53.179953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:45:53.179953 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:45:53.187361 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-743fde4e-7ccd-4fe9-bddb-f2176d4b9707 req-2345e849-d8d0-496c-a871-e0e45ea2e91f service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:45:53.187812 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-743fde4e-7ccd-4fe9-bddb-f2176d4b9707 req-2345e849-d8d0-496c-a871-e0e45ea2e91f service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:45:53.198824 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-743fde4e-7ccd-4fe9-bddb-f2176d4b9707 req-2345e849-d8d0-496c-a871-e0e45ea2e91f service nova] Creating event network-changed:436369f6-dff7-4ec3-ad22-70faf21d52fc for instance 4d821bfc-fe28-4943-bbf6-2292f4b0df79 on hv-cinder-82204 Feb 08 17:45:53.203889 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-743fde4e-7ccd-4fe9-bddb-f2176d4b9707 req-2345e849-d8d0-496c-a871-e0e45ea2e91f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029741 Feb 08 17:45:53.204847 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 573/1121] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:46:30.262005 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:46:30.262644 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: Tue Feb 8 17:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:46:46.390792 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:46:46.391440 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: Tue Feb 8 17:46:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:46:55.956804 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:46:55.957537 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: Tue Feb 8 17:46:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:47:29.214932 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-6afb643e-e8bf-427a-a8a1-5bc7b20cdc9c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:29.215560 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6afb643e-e8bf-427a-a8a1-5bc7b20cdc9c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:29.230640 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6afb643e-e8bf-427a-a8a1-5bc7b20cdc9c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:29.231092 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6afb643e-e8bf-427a-a8a1-5bc7b20cdc9c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:29.232513 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6afb643e-e8bf-427a-a8a1-5bc7b20cdc9c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:29.232954 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-6afb643e-e8bf-427a-a8a1-5bc7b20cdc9c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:29.263883 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-6afb643e-e8bf-427a-a8a1-5bc7b20cdc9c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Going to try to terminate instance {{(pid=116479) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:47:29.280233 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-297e3fc4-333d-45bd-b5f2-a8a86f02463a req-2ba151cb-6d48-40ed-91c0-c4943da01d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d821bfc-fe28-4943-bbf6-2292f4b0df79", "tag": "436369f6-dff7-4ec3-ad22-70faf21d52fc"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:47:29.282024 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:47:29.282024 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:47:29.290156 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-297e3fc4-333d-45bd-b5f2-a8a86f02463a req-2ba151cb-6d48-40ed-91c0-c4943da01d3f service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:29.290926 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-297e3fc4-333d-45bd-b5f2-a8a86f02463a req-2ba151cb-6d48-40ed-91c0-c4943da01d3f service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:29.302525 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-297e3fc4-333d-45bd-b5f2-a8a86f02463a req-2ba151cb-6d48-40ed-91c0-c4943da01d3f service nova] Creating event network-changed:436369f6-dff7-4ec3-ad22-70faf21d52fc for instance 4d821bfc-fe28-4943-bbf6-2292f4b0df79 on hv-cinder-82204 Feb 08 17:47:29.308049 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-297e3fc4-333d-45bd-b5f2-a8a86f02463a req-2ba151cb-6d48-40ed-91c0-c4943da01d3f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094566 Feb 08 17:47:29.309020 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 574/1122] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:47:29.359847 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-6afb643e-e8bf-427a-a8a1-5bc7b20cdc9c tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 204 len: 0 microversion: 2.1 time: 0.149237 Feb 08 17:47:29.361121 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 549/1123] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:47:29 2022] DELETE /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:47:29.370085 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-8c776ddd-d10d-4b27-8787-a1fc77dfebf4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:29.371295 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-8c776ddd-d10d-4b27-8787-a1fc77dfebf4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:29.379703 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8c776ddd-d10d-4b27-8787-a1fc77dfebf4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:29.380546 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8c776ddd-d10d-4b27-8787-a1fc77dfebf4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:29.381842 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8c776ddd-d10d-4b27-8787-a1fc77dfebf4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:29.382554 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-8c776ddd-d10d-4b27-8787-a1fc77dfebf4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:29.554200 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-8c776ddd-d10d-4b27-8787-a1fc77dfebf4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:47:29.562075 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-8c776ddd-d10d-4b27-8787-a1fc77dfebf4 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1576 microversion: 2.1 time: 0.196275 Feb 08 17:47:29.563009 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 575/1124] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:47:29 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:47:30.583792 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0043cff3-573c-4c97-a730-c415ae480e66 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:30.585127 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-0043cff3-573c-4c97-a730-c415ae480e66 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:30.592913 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0043cff3-573c-4c97-a730-c415ae480e66 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:30.594421 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0043cff3-573c-4c97-a730-c415ae480e66 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:30.594421 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0043cff3-573c-4c97-a730-c415ae480e66 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:30.594648 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-0043cff3-573c-4c97-a730-c415ae480e66 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:30.761112 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-0043cff3-573c-4c97-a730-c415ae480e66 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:47:30.769954 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0043cff3-573c-4c97-a730-c415ae480e66 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1457 microversion: 2.1 time: 0.192918 Feb 08 17:47:30.770550 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 550/1125] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:47:30 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1457 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:47:31.637793 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-a18e4729-7d92-4300-8b7a-920867e9004b req-737ebdb0-3122-4d98-8b72-7fd63ac29ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d821bfc-fe28-4943-bbf6-2292f4b0df79", "name": "network-vif-deleted", "tag": "436369f6-dff7-4ec3-ad22-70faf21d52fc"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:47:31.639620 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:47:31.639620 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:47:31.648504 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-a18e4729-7d92-4300-8b7a-920867e9004b req-737ebdb0-3122-4d98-8b72-7fd63ac29ba6 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:31.648994 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-a18e4729-7d92-4300-8b7a-920867e9004b req-737ebdb0-3122-4d98-8b72-7fd63ac29ba6 service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:31.660488 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-a18e4729-7d92-4300-8b7a-920867e9004b req-737ebdb0-3122-4d98-8b72-7fd63ac29ba6 service nova] Creating event network-vif-deleted:436369f6-dff7-4ec3-ad22-70faf21d52fc for instance 4d821bfc-fe28-4943-bbf6-2292f4b0df79 on hv-cinder-82204 Feb 08 17:47:31.665887 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-a18e4729-7d92-4300-8b7a-920867e9004b req-737ebdb0-3122-4d98-8b72-7fd63ac29ba6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031948 Feb 08 17:47:31.666498 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 576/1126] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:47:31.788246 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-4944ac32-d6dd-4e74-aa06-af59a6d9677e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:31.788886 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-4944ac32-d6dd-4e74-aa06-af59a6d9677e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:31.796113 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4944ac32-d6dd-4e74-aa06-af59a6d9677e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:31.796553 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4944ac32-d6dd-4e74-aa06-af59a6d9677e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:31.797390 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4944ac32-d6dd-4e74-aa06-af59a6d9677e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:31.797825 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-4944ac32-d6dd-4e74-aa06-af59a6d9677e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:31.862271 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-4944ac32-d6dd-4e74-aa06-af59a6d9677e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:47:31.870269 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-4944ac32-d6dd-4e74-aa06-af59a6d9677e tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 200 len: 1225 microversion: 2.1 time: 0.085736 Feb 08 17:47:31.870855 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 551/1127] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:47:31 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:47:32.888572 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-be0b0ac8-c006-4ff9-b299-b478ff770852 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:32.889876 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-be0b0ac8-c006-4ff9-b299-b478ff770852 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 4d821bfc-fe28-4943-bbf6-2292f4b0df79] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:32.895981 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be0b0ac8-c006-4ff9-b299-b478ff770852 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:32.896434 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be0b0ac8-c006-4ff9-b299-b478ff770852 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:32.897238 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be0b0ac8-c006-4ff9-b299-b478ff770852 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:32.897681 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-be0b0ac8-c006-4ff9-b299-b478ff770852 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:32.911046 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-be0b0ac8-c006-4ff9-b299-b478ff770852 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] HTTP exception thrown: Instance 4d821bfc-fe28-4943-bbf6-2292f4b0df79 could not be found. Feb 08 17:47:32.911636 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-be0b0ac8-c006-4ff9-b299-b478ff770852 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Returning 404 to user: Instance 4d821bfc-fe28-4943-bbf6-2292f4b0df79 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:47:32.912475 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-be0b0ac8-c006-4ff9-b299-b478ff770852 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79" status: 404 len: 111 microversion: 2.1 time: 0.028662 Feb 08 17:47:32.913034 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 577/1128] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:47:32 2022] GET /compute/v2.1/servers/4d821bfc-fe28-4943-bbf6-2292f4b0df79 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:47:35.987134 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-2260230d-cc39-42fa-a231-5976bbb3b073 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:35.987720 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2260230d-cc39-42fa-a231-5976bbb3b073 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:35.991408 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-153529be-7e2e-4bb0-bbc9-891c94cfed89 req-303efdd9-8375-4a59-bc26-a098a320c65e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7d62d9-29ba-4b7d-8c8e-f258e5758129", "tag": "625fdd0a-3cda-4343-be95-b1644117908b"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:47:35.993587 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:47:35.993587 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:47:35.994577 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2260230d-cc39-42fa-a231-5976bbb3b073 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:35.995028 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2260230d-cc39-42fa-a231-5976bbb3b073 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:35.996054 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2260230d-cc39-42fa-a231-5976bbb3b073 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:35.996431 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-2260230d-cc39-42fa-a231-5976bbb3b073 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:36.002852 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-153529be-7e2e-4bb0-bbc9-891c94cfed89 req-303efdd9-8375-4a59-bc26-a098a320c65e service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:36.003295 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-153529be-7e2e-4bb0-bbc9-891c94cfed89 req-303efdd9-8375-4a59-bc26-a098a320c65e service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:36.018336 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-153529be-7e2e-4bb0-bbc9-891c94cfed89 req-303efdd9-8375-4a59-bc26-a098a320c65e service nova] Creating event network-changed:625fdd0a-3cda-4343-be95-b1644117908b for instance 6a7d62d9-29ba-4b7d-8c8e-f258e5758129 on hv-cinder-82204 Feb 08 17:47:36.024110 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-153529be-7e2e-4bb0-bbc9-891c94cfed89 req-303efdd9-8375-4a59-bc26-a098a320c65e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036186 Feb 08 17:47:36.025274 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 578/1129] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 17:47:36.191431 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-2260230d-cc39-42fa-a231-5976bbb3b073 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Going to try to terminate instance {{(pid=116479) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 17:47:36.275739 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-2260230d-cc39-42fa-a231-5976bbb3b073 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 204 len: 0 microversion: 2.1 time: 0.292263 Feb 08 17:47:36.278885 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 552/1130] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:47:35 2022] DELETE /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 17:47:36.289512 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-4cd9a843-d3b2-4fff-bbd6-ed581b79c728 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:36.291825 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-4cd9a843-d3b2-4fff-bbd6-ed581b79c728 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:36.301132 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4cd9a843-d3b2-4fff-bbd6-ed581b79c728 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:36.301861 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4cd9a843-d3b2-4fff-bbd6-ed581b79c728 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:36.302941 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4cd9a843-d3b2-4fff-bbd6-ed581b79c728 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:36.303545 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-4cd9a843-d3b2-4fff-bbd6-ed581b79c728 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:36.480340 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.policy [None req-4cd9a843-d3b2-4fff-bbd6-ed581b79c728 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116480) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:47:36.491348 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-4cd9a843-d3b2-4fff-bbd6-ed581b79c728 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1575 microversion: 2.1 time: 0.207792 Feb 08 17:47:36.493206 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 579/1131] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:47:36 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:47:37.509443 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-06b047dc-688b-4e1b-9d66-d9c5c0326ecf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:37.510148 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-06b047dc-688b-4e1b-9d66-d9c5c0326ecf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:37.518198 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-06b047dc-688b-4e1b-9d66-d9c5c0326ecf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:37.518723 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-06b047dc-688b-4e1b-9d66-d9c5c0326ecf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:37.519653 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-06b047dc-688b-4e1b-9d66-d9c5c0326ecf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:37.520202 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-06b047dc-688b-4e1b-9d66-d9c5c0326ecf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:37.694908 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-06b047dc-688b-4e1b-9d66-d9c5c0326ecf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:47:37.703880 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-06b047dc-688b-4e1b-9d66-d9c5c0326ecf tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1456 microversion: 2.1 time: 0.198272 Feb 08 17:47:37.704614 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 553/1132] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:47:37 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1456 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:47:38.485595 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [req-eb8a2212-b470-4e7c-baa5-be443b7d5d14 req-ae1b1f59-5c2d-4f10-a1eb-b98476b025ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7d62d9-29ba-4b7d-8c8e-f258e5758129", "name": "network-vif-deleted", "tag": "625fdd0a-3cda-4343-be95-b1644117908b"}]} {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 17:47:38.487105 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 17:47:38.487105 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: warnings.warn(msg) Feb 08 17:47:38.495778 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-eb8a2212-b470-4e7c-baa5-be443b7d5d14 req-ae1b1f59-5c2d-4f10-a1eb-b98476b025ff service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:38.496226 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [req-eb8a2212-b470-4e7c-baa5-be443b7d5d14 req-ae1b1f59-5c2d-4f10-a1eb-b98476b025ff service nova] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:38.510209 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.compute.server_external_events [req-eb8a2212-b470-4e7c-baa5-be443b7d5d14 req-ae1b1f59-5c2d-4f10-a1eb-b98476b025ff service nova] Creating event network-vif-deleted:625fdd0a-3cda-4343-be95-b1644117908b for instance 6a7d62d9-29ba-4b7d-8c8e-f258e5758129 on hv-cinder-82204 Feb 08 17:47:38.516198 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [req-eb8a2212-b470-4e7c-baa5-be443b7d5d14 req-ae1b1f59-5c2d-4f10-a1eb-b98476b025ff service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034204 Feb 08 17:47:38.516871 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 580/1133] 10.222.0.69 () {64 vars in 1317 bytes} [Tue Feb 8 17:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 17:47:38.721606 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-e612a640-60f3-4ccc-a901-990ef4aef54b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:38.722139 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-e612a640-60f3-4ccc-a901-990ef4aef54b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:38.729138 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e612a640-60f3-4ccc-a901-990ef4aef54b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:38.729687 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e612a640-60f3-4ccc-a901-990ef4aef54b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:38.730622 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e612a640-60f3-4ccc-a901-990ef4aef54b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:38.731141 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e612a640-60f3-4ccc-a901-990ef4aef54b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:38.769823 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e612a640-60f3-4ccc-a901-990ef4aef54b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:38.770282 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-e612a640-60f3-4ccc-a901-990ef4aef54b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:38.770751 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.objects.instance [None req-e612a640-60f3-4ccc-a901-990ef4aef54b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lazy-loading 'fault' on Instance uuid 6a7d62d9-29ba-4b7d-8c8e-f258e5758129 {{(pid=116479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 17:47:38.814148 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.policy [None req-e612a640-60f3-4ccc-a901-990ef4aef54b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d8937bf8cf40019ff86f19cecf7b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a62a1727984ff69d6de64fdfb1137e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116479) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 17:47:38.824458 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-e612a640-60f3-4ccc-a901-990ef4aef54b tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 200 len: 1229 microversion: 2.1 time: 0.106964 Feb 08 17:47:38.825128 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 554/1134] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:47:38 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 17:47:39.844550 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9a79644b-204e-4f03-8255-8d668c8519fd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:39.845288 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-9a79644b-204e-4f03-8255-8d668c8519fd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 6a7d62d9-29ba-4b7d-8c8e-f258e5758129] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:39.851311 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9a79644b-204e-4f03-8255-8d668c8519fd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:39.851760 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9a79644b-204e-4f03-8255-8d668c8519fd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:39.852533 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9a79644b-204e-4f03-8255-8d668c8519fd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:39.852990 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-9a79644b-204e-4f03-8255-8d668c8519fd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:39.866188 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-9a79644b-204e-4f03-8255-8d668c8519fd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] HTTP exception thrown: Instance 6a7d62d9-29ba-4b7d-8c8e-f258e5758129 could not be found. Feb 08 17:47:39.867224 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-9a79644b-204e-4f03-8255-8d668c8519fd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Returning 404 to user: Instance 6a7d62d9-29ba-4b7d-8c8e-f258e5758129 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:47:39.868051 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-9a79644b-204e-4f03-8255-8d668c8519fd tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129" status: 404 len: 111 microversion: 2.1 time: 0.028990 Feb 08 17:47:39.868583 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 581/1135] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:47:39 2022] GET /compute/v2.1/servers/6a7d62d9-29ba-4b7d-8c8e-f258e5758129 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:47:40.340342 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5920315a-2c0f-457a-920f-ac6eda3d0433 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:40.341122 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.compute.api [None req-5920315a-2c0f-457a-920f-ac6eda3d0433 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116479) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:40.347552 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5920315a-2c0f-457a-920f-ac6eda3d0433 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:40.347938 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5920315a-2c0f-457a-920f-ac6eda3d0433 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:40.348724 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5920315a-2c0f-457a-920f-ac6eda3d0433 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:40.349176 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG oslo_concurrency.lockutils [None req-5920315a-2c0f-457a-920f-ac6eda3d0433 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:40.362101 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.wsgi [None req-5920315a-2c0f-457a-920f-ac6eda3d0433 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] HTTP exception thrown: Instance 7c59cc32-12d5-4231-8e96-f46b9f36ec47 could not be found. Feb 08 17:47:40.362685 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-5920315a-2c0f-457a-920f-ac6eda3d0433 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Returning 404 to user: Instance 7c59cc32-12d5-4231-8e96-f46b9f36ec47 could not be found. {{(pid=116479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:47:40.363531 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-5920315a-2c0f-457a-920f-ac6eda3d0433 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 404 len: 111 microversion: 2.1 time: 0.027346 Feb 08 17:47:40.364055 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 555/1136] 10.222.0.69 () {58 vars in 1238 bytes} [Tue Feb 8 17:47:40 2022] DELETE /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:47:40.372103 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c46e8afd-44f8-46b1-b85d-ad3fea6dfa82 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '>' {{(pid=116480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:40.372716 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.compute.api [None req-c46e8afd-44f8-46b1-b85d-ad3fea6dfa82 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] [instance: 7c59cc32-12d5-4231-8e96-f46b9f36ec47] Fetching instance by UUID {{(pid=116480) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 17:47:40.379686 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c46e8afd-44f8-46b1-b85d-ad3fea6dfa82 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:40.380140 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c46e8afd-44f8-46b1-b85d-ad3fea6dfa82 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:40.380917 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c46e8afd-44f8-46b1-b85d-ad3fea6dfa82 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 17:47:40.381393 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG oslo_concurrency.lockutils [None req-c46e8afd-44f8-46b1-b85d-ad3fea6dfa82 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Lock "15ce609a-5a92-491c-9260-447d239d1ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 17:47:40.395331 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.wsgi [None req-c46e8afd-44f8-46b1-b85d-ad3fea6dfa82 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] HTTP exception thrown: Instance 7c59cc32-12d5-4231-8e96-f46b9f36ec47 could not be found. Feb 08 17:47:40.395907 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: DEBUG nova.api.openstack.wsgi [None req-c46e8afd-44f8-46b1-b85d-ad3fea6dfa82 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Returning 404 to user: Instance 7c59cc32-12d5-4231-8e96-f46b9f36ec47 could not be found. {{(pid=116480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 17:47:40.396717 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO nova.api.openstack.requestlog [None req-c46e8afd-44f8-46b1-b85d-ad3fea6dfa82 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47" status: 404 len: 111 microversion: 2.1 time: 0.028333 Feb 08 17:47:40.397260 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: [pid: 116480|app: 0|req: 582/1137] 10.222.0.69 () {58 vars in 1235 bytes} [Tue Feb 8 17:47:40 2022] GET /compute/v2.1/servers/7c59cc32-12d5-4231-8e96-f46b9f36ec47 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 17:47:41.679142 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: DEBUG nova.api.openstack.wsgi [None req-0108a31f-d24c-4ccc-9b75-65e2e34b2213 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] Calling method '.version_select at 0x7fd9f98bfee0>' {{(pid=116479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 17:47:41.704092 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO nova.api.openstack.requestlog [None req-0108a31f-d24c-4ccc-9b75-65e2e34b2213 tempest-TestVolumeBootPattern-17481033 tempest-TestVolumeBootPattern-17481033-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-395420825" status: 202 len: 0 microversion: 2.1 time: 0.028635 Feb 08 17:47:41.708606 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: [pid: 116479|app: 0|req: 556/1138] 10.222.0.69 () {58 vars in 1259 bytes} [Tue Feb 8 17:47:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-395420825 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 17:48:24.801284 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:48:24.802045 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: Tue Feb 8 17:48:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:49:50.270767 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:49:50.276059 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: Tue Feb 8 17:49:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:50:06.399408 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:50:06.400053 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: Tue Feb 8 17:50:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:50:15.965097 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:50:15.965708 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: Tue Feb 8 17:50:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:50:22.881348 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:50:22.881991 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: Tue Feb 8 17:50:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:51:44.809800 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:51:44.810471 dv-cinder-822040-2-iscsi devstack@n-api.service[116479]: Tue Feb 8 17:51:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:53:10.279983 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:53:10.280596 dv-cinder-822040-2-iscsi devstack@n-api.service[116480]: Tue Feb 8 17:53:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!